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Abstract 

An  indirect  adaptive  and  reconfigurable  flight  control  system  is  developed.  The 
three-module  controller  consists  of  1)  a  system  identification  module,  2)  a  parameter 
estimate  smoother,  and  3)  a  proportional  and  integral  compensator  for  tracking 
control.  Specifically:  1)  The  identification  of  a  linear  discrete-time  control  system’s 
open-loop  gain  is  addressed.  The  classical  Kalman  filter  theory  for  linear  control 
systems  is  extended  and  the  control  system’s  state  and  loop  gain  are  jointly  estimated 
on-line.  Explicit  formulae  for  the  loop  gain’s  estimate  and  estimation  error  covariance 
are  derived.  The  estimate  is  unbiased  and  the  predicted  covariance  is  reliable.  2)  An 
adaptive  smoother  is  developed  to  reduce  the  fluctuations  automatically  in  the  gain 
estimate,  and  bursting,  caused  by  instances  of  poor  excitation.  3)  Special  attention  is 
given  to  the  design  of  a  proportional  and  integral  tracking  controller.  The  outputs  of 
the  system  identification  and  gain  smoother  modules  are  used  to  adjust  the  tracking 
controller’s  gain  continuously  in  order  to  compensate  for  a  possible  reduction  in  the 
loop  gain  due  to  control  surface  area  loss,  thus  achieving  the  benefits  of  adaptive  and 
reconfigurable  control.  The  performance  of  the  adaptive  and  reconfigurable  controller 
in  the  face  of  a  simulated  control  surface  failure  is  examined  in  carefully  designed 
experiments.  The  adaptive  controller  developed  in  this  dissertation  and  illustrated 
in  a  flight  control  context  is  applicable  to  a  wide  range  of  control  problems. 
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Adaptive  and  Reconfigurable  Flight  Control 


I.  Introduction 

Feedback  is  used  to  address  the  deleterious  effects  brought  about  by  the  un¬ 
structured  environment  in  which  the  controlled  plant  is  operating.  This  includes 
plant  parameter  uncertainty,  unmodeled  dynamics  and  input  disturbances.  At  the 
same  time,  the  benefits  of  feedback  control  are  limited  by  actuator  saturation  and 
sensor  noise,  in  particular  when  high  gain  feedback  control  is  used  [11]. 

System  identification  fits  well  into  the  feedback  control  paradigm  for  it  allows 
us  to  acquire  the  estimates  of  the  plant’s  parameters  from  measurements  on  the 
system’s  inputs  and  outputs  using  algorithms  and  software,  but  without  adding 
extra  hardware,  i.e.,  sensors  or  actuators  [13].  Thus,  the  uncertainty  is  reduced 
and  lower  gain  feedback  might  be  used.  Unfortunately,  system  identification,  which 
entails  the  estimation  of  all  the  (linear)  plant’s  parameters,  resides  in  the  realm  of 
nonlinear  filtering.  Moreover,  system  identification  for  adaptive  and  reconfigurable 
flight  control  requires  a)  the  accurate  and  reliable  estimation  of  the  aircraft’s  stability 
and  control  derivatives  with  on-line  operation,  b)  accurate  and  reliable  estimation 
at  low  SNR,  c)  the  use  of  a  small  sample,  and  d)  no  human  intervention. 

In  the  statistical  linear  regression  paradigm,  static  system  identification  of 
the  parameters  of  the  dynamical  system  affords  reliable  real-time  operation  [19]. 
Static  system  identification  is  also  well  suited  to  aircraft  parameter  estimation  since 
measurements  of  aircraft  states  and  state  rates  are  readily  available  [3,  5,  6]. 

It  is  shown  in  this  dissertation  that,  in  linear  control  systems,  and  provided  that 
the  dynamics  (A)  matrix  is  known,  the  exclusive  estimation  of  the  critical  parameters 
of  the  control  ( B )  matrix  only  is  also  reducible  to  a  problem  in  linear  regression  and 
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therefore  is  amenable  to  linear  analysis.  Hence,  a  rigorous,  and  unbiased  real-time 
estimate  of  the  parameters  of  the  control  matrix  and  a  reliable  predicted  estima¬ 
tion  error  covariance  can  be  obtained.  The  classical  Kalman  filter  theory  for  linear 
control  systems  is  extended  and  the  control  system’s  state  and  loop  gain  are  jointly 
estimated.  Explicit  formulae  for  the  loop  gain’s  estimate  and  predicted  estimation 
error  covariance  are  obtained.  In  this  dissertation,  this  approach  is  pursued.  A  sim¬ 
plified  (single  input)  version  of  this  problem  is  addressed  and  an  algorithm  for  the 
estimation  of  a  single-input  flight  control  system’s  critical  loop  gain  parameter  is 
developed  [26].  The  inclusion  of  a  “forgetting  factor”  into  this  basic  algorithm,  or 
the  employment  of  a  sliding  window,  will  afford  the  real-time  identification  of  a  time- 
varying  parameter  -  the  plant’s  open-loop  gain.  Thus,  adaptive  and  reconfigurable 
flight  control  is  possible. 

Although  the  estimation  problem  addressed  in  this  dissertation  is  amenable  to  a 
rigorous  analysis  and  solution,  the  end-to-end  adaptive  control  problem  is  nonlinear 
due  to  the  presence  of  an  unknown  plant  parameter.  Therefore,  we  do  not  have 
the  benefit  of  a  Separation  Theorem.  Hence,  an  adaptive  smoother  is  developed  in 
this  dissertation  to  reduce  the  fluctuations  automatically  in  the  parameter  estimate 
caused  by  measurement  noise,  and  bursting,  caused  by  instances  of  poor  excitation, 
prior  to  the  use  of  the  parameter  estimate  in  the  controller.  As  we  move  from  window 
to  window,  the  fluctuations  in  the  parameter  estimate  are  further  exacerbated  by 
the  presence  of  modeling  error.  Hence  the  importance  of  the  parameter  estimate 
smoother. 

Furthermore,  special  attention  is  given  to  the  design  of  a  proportional  and  inte¬ 
gral  tracking  controller.  The  outputs  of  the  system  identification  and  gain  smoother 
module  are  used  to  adjust  the  tracking  controller’s  gain  continuously. 

Thus,  an  indirect  adaptive  and  reconfigurable  control  system  is  developed.  The 
controller  consists  of  three  modules:  1)  A  system  identification  module,  2)  a  parame¬ 
ter  estimate  smoother,  and  3)  a  proportional  and  integral  compensator  for  tracking 
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Figure  1.  Adaptive  and  Reconfigurable  Flight  Control  System 

control.  The  architecture  of  an  indirect  adaptive  and  reconfigurable  flight  control 
system  which  incorporates  the  on-line  loop  gain  identification  algorithm,  adaptive 
loop  gain  estimate  smoother,  and  tracking  controller  developed  in  this  dissertation 
is  shown  in  Figure  1. 

1.1  Assumptions 

The  plant  dynamics  are  assumed  to  be  known.  We  proceed  under  the  assump¬ 
tion  that  the  loss  in  elevator  surface  area  does  not  significantly  change  the  overall 
aircraft  dynamics.  For  this  reason,  the  identification  of  the  aircraft’s  dynamics  (A) 
matrix  parameters  is  not  undertaken  and  the  focus  is  on  the  control  matrix  B,  viz., 
the  identification  of  the  open-loop  plant’s  gain,  a  reduction  of  which  models  the 
degree  of  failure,  i.e.,  control  surface  area  loss. 

The  system  order  is  assumed  known.  Model  order  determination  is  not  ad¬ 
dressed  in  this  dissertation  for  it  is  not  a  dominant  issue  in  flight  control  [21],  The 
“short-period”  aircraft  dynamics  approximation  is  used  and  the  very  low  frequency 
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Phugoid  dynamics  can  be  neglected  [18,  21].  This  is  so  because  the  period  of  the 
Phugoid  oscillation  is  about  sixty  seconds  whereas  the  period  of  the  short-period 
oscillation  is  about  one  second.  Moreover,  since  this  research  deals  with  inner  loop 
control  and  control  surface  failure,  the  control  time  horizon  is  short.  This  is  to 
prevent  aircraft  departure,  in  particular  when  the  open-loop  plant  is  not  stable  and 
feedback  control  is  used  for  stabilization.  Thus,  the  time  scale  of  interest  for  es¬ 
timation  and  control  is  rather  short,  and  neglecting  the  Phugoid  is  justified.  The 
bandwidth  of  the  actuator  is  sufficiently  high  and  therefore  the  actuator  and  the 
aircraft’s  “short-period”  dynamics  are  separated,  and  a  first-order  actuator  model 
is  satisfactory.  These  assumptions  are  validated  in  the  simulation  experiments,  in 
which  the  unmodeled  high  frequency  actuator,  low  frequency  Phugoid  dynamics,  and 
parametric  uncertainty,  are  included. 

The  aircraft  model  is  assumed  to  be  statically  unstable  to  apply  to  modern 
fighter  aircraft.  Our  three-module  controller  can  also  handle  a  stable  aircraft  plant, 
since  the  tracking  controller  is  easier  to  design  for  a  stable  plant. 

The  benefit  accrued  from  using  a  reduced  order  plant  model  for  model  based 
control  design:  When  dealing  with  the  short-period  approximation  of  an  aircraft, 
both  the  a  (angle  of  attack)  and  q  (pitch  rate)  signals  are  available  for  feedback, 
as  is  the  elevator  deflection  6e,  and  thus  full-state  feedback  control  is  possible  -  see, 
e.g.,  Figure  3  in  the  sequel. 

1.2  System  Identification  Problem  Statement 

Indirect  adaptive  control  relies  on  system  identification.  The  plant  truth  model 
of  the  system  identification  algorithm  is  the  linear  discrete-time  single-input  multiple- 
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output  stochastic  control  system  (as  shown  in  Figure  1) 


Xfe+i  =  Axk  +  Kbuk  +  Twk,  E(wkwl)  =  Q,  xk  e  5F1  (1) 

x0  =  N(x0P0xx)  (2) 

K  =  N(Kq,Pokk)  (3) 

Vk+i  =  Cxk+ 1  (4) 

zk+ 1  =  2/fe+r+Vfc+i,  F(ufc+iuJ+1)  =  i?  (5) 


where 


k  =  0,1,...., AT-  1 


In  the  special  case  of  a  single  output,  the  matrix  C  is  a  row  vector  cT  and  the 
measurement  Eq.  (5)  is  simplified  to 


zk+ 1  =  s/k+i  +  vjk+i,  ufc+i  =  iV(0,  cr2) 


(6) 


In  the  specific  flight  control  application  under  consideration,  the  states  a  and  q 
denote  the  aircraft’s  angle  of  attack  and  pitch  rate,  respectively,  and  the  control 
signal  <5e  is  the  elevator  deflection. 

The  dynamics  matrix  A,  the  control  vector  b,  the  observation  matrix  C  and 
the  vector  T  are  all  known.  The  process  noise  intensity,  Q,  and  the  sensor  noise 
intensity,  R  (or  a2),  are  also  known.  In  addition,  the  prior  information  specified  in 
Eqs.  (2)  and  (3)  is  provided.  For  an  unfailed  plant  (aircraft)  the  loop  gain  K  =  1  (by 
definition),  until  a  failure  at  time  tf  reduces  the  control  derivative,  and  K  =  Kx  <  1 
thereafter  [3]. 

For  a  multiple-input  system,  the  second  term  in  the  right-hand  side  of  Eq.  (1) 
becomes  BKuk,  where  B  is  the  control  matrix,  K  is  the  loop  gain  matrix  and  uk  is  the 
input  vector.  In  this  dissertation  we  will  deal  with  the  single-input  multiple-output 
stochastic  control  system  only,  since  our  aircraft  plant  is  a  single-input  multiple- 
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output  model.  However,  the  methodology  in  this  dissertation  can  be  applied  to  a 
multiple-input  multiple-output  plant. 

The  objective  is  to  identify  the  scalar  loop  gain  K  from  the  input  sequence 
Uq,Ui,  ,...,U/v-i  and  the  recorded  measurements,  z\,  Z2, z^.  A  rigorous  system 
identification  algorithm  is  developed.  The  classical  Kalman  filter  theory  for  linear 
control  systems  [4,  5,  6,  7]  is  extended  and  the  control  system’s  state  and  loop  gain 
are  jointly  estimated.  Explicit  formula  for  the  loop  gain’s  estimate  and  predicted 
estimation  error  covariance  are  derived.  The  estimate  of  the  system’s  state  and 
the  covariance  of  the  state  estimation  error  are  also  obtained.  A  sampling  rate  of 
100Hz  is  used  and  in  our  estimation  algorithm  the  continuous-time  plant  dynamics 
are  discretized  accordingly. 

1.3  Adaptive  and  Reconfigurable  Control  System 

The  proposed  three-module  adaptive  and  reconfigurable  control  system  is  shown 
in  Figure  1.  The  pilot  inputs  a  pitch  rate  command,  qc ,  which  is  the  reference  signal 
for  the  adaptive  controller.  The  commanded  input  is  passed  through  a  low  pass 
prefilter  and  into  a  proportional  (P)  or  proportional  and  integral  (PI)  controller  de¬ 
signed  to  yield  good  tracking  performance.  The  identification  algorithm,  i.e.,  the 
modified  Kalman  filter,  is  fed  with  the  noise  corrupted  measurements  of  the  states 
of  the  plant,  am  and  qm,  and  the  input  to  the  plant,  6e.  The  a,  q  and  K  estimates 
of  a,  q  and  K,  respectively,  are  provided  by  the  modified  Kalman  filter/system  iden¬ 
tification  module  at  each  time  sample.  The  a,  q  and  6e  (elevator  deflection  angle) 
are  fed  back  and  summed  with  the  reference  signal  r  in  the  proportional  and  in¬ 
tegral  (linear)  tracking  compensator.  The  system  identification  module  outputs  an 
estimate  K  of  the  loop  gain  and  computes  the  loop  gain  estimation  error  variance. 
This  information  is  fed  to  an  adaptive  smoother  module  which  calculates  a  smoothed 
estimate  Ks  of  K.  The  filtered  loop  gain  estimate  (I<s)  is  fed  back  into  the  forward 
path  after  the  summing  junction  of  the  states  and  signal  r,  but  before  the  actuator, 
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to  compensate  for  the  changing  open-loop  gain  K  due  to  plant  failure,  i.e.,  a  loss 
in  control  surface  area.  Thus,  the  control  signal  8Cc  which  is  the  input  to  the  actu¬ 
ator  is  formed  from  the  feedback  filtered  state  measurements,  the  reference  signal, 
and  the  output  of  the  system  identification  and  adaptive  smoother  modules.  The 
indirect  adaptive  and  reconfigurable  control  design  methodology  developed  in  this 
dissertation  and  illustrated  in  a  flight  control  context  is  applicable  to  a  wide  range 
of  control  problems. 

The  plant  model  is  representative  of  the  longitudinal  dynamics  of  an  F-16 
class  aircraft.  The  open  loop  plant  is  unstable  and  feedback  control  is  used  for 
stabilization.  The  first  order  actuator  model  used  herein  is  representative  of  the 
elevator  of  an  F-16  class  aircraft. 

This  dissertation  is  organized  as  follows.  The  basic  concept  of  the  system  iden¬ 
tification  is  presented  in  Chapter  2.  The  system  identification  algorithm  for  loop  gain 
estimation  is  provided  in  Chapter  3.  The  adaptive  loop  gain  smoothing  algorithm  is 
developed  in  Chapter  4  and  the  design  of  the  linear  tracking  controller  is  discussed 
in  Chapter  5.  The  aircraft  model  is  discussed  in  Chapter  6.  The  experimental  setup 
and  the  simulation  results  are  presented  in  Chapter  7,  followed  by  conclusions  in 
Chapter  8. 
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II.  System  Identification 


2. 1  Introduction 

This  chapter  provides  general  background  knowledge  of  relevant  and  applicable 
system  identification  techniques.  Both  the  classical  and  digital  signal  processing 
based  method  are  explained  and  examples  are  given.  Also,  some  concerns  and  design 
considerations  related  to  system  identification  are  addressed. 

When  modeling  a  system,  there  are  two  approaches  to  be  considered,  the  de¬ 
ductive  and  empirical  approaches  [22].  With  deductive  modeling,  the  laws  and  equa¬ 
tions  found  in  physics  and  engineering  are  used  to  derive  the  proper  model.  With  the 
empirical  approach,  i.e.,  statistical  system  identification,  least  squares  and  Kalman 
filter  estimates  are  used  to  form  a  model  for  predicting  the  dynamics  of  the  system. 

System  identification  has  more  applications  than  just  for  modeling  purposes. 
It  is  also  a  useful  technique  for  model  order  reduction  of  a  plant  or  compensator,  for 
measuring  or  estimating  parameters,  and  for  real  time  adaptive  control. 

One  of  the  challenges  that  needs  to  be  addressed  is  modeling  error,  especially 
when  the  real  order  n  of  a  best  model  (by  some  specified  criterion)  for  the  system  is 
not  known.  Additional  error  sources  are  disturbances  such  as  process  and  measure¬ 
ment  noises.  When  determining  the  unknown  parameters  of  a  higher  order  model, 
the  excess  parameters  of  the  physical  system  should  equal  zero.  However,  this  does 
not  happen  because  of  noise.  Rather,  the  critical  parameter  estimates  are  biased. 
Over-modeling  is  not  advisable  in  system  identification.  Although  it  may  seem  log¬ 
ical  to  over-model  a  system,  the  extra  parameters  would  be  redundant  and  would 
make  the  determination  of  the  critical  system’s  parameters  impossible.  Therefore,  it 
is  better  to  under-estimate  the  order  of  the  unknown  system  than  to  over-estimate 
it.  Under- modeling  requires  determining  values  for  the  parameters  that  yield  the 
best  fit  over  a  desired  bandwidth. 
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2.2  Frequency  Domain-Based  Continuous-Time  System  Identification 

Discrete-time  system  identification  is  well  suited  for  a  digital  signal  processing- 
based  algorithm.  Special  attention  needs  to  be  given  to  continuous-time  system 
identification. 

Consider  the  continuous-time  transfer  function  [22] 

,  N  y(s)  £>isn-1  +  b2sn~2  +  ....  +  bn_is  +  bn  (  ^ 

n(S)  =  -r  =  - : - r -  .  {/) 

u(s )  sn  —  ajs”-1  —  a2sn~2  —  ....  —  an_is  —  an 

If  we  chose  the  input  to  be 

uk(t)  =  sin cokt,  0  <  t  (8) 


then  the  output  is  the  phasor 

yk(t)  =  (Ak  +  jBk)  sin  ukt 

=  y/^h  sin(ukt  +  4>) 

=  Asm(u}kt  +  4>)  (9) 

where 

<p  =  Arc  tan(— .  (10) 

A  k 

Letting  s  =  jui  and  substitution  into  H(s) 

H(s )  =  ^f\^Ak  +  jBk 

u{s) 

_ frlCM:)"-1  +  fc2(j^fc)n~2  +  ••••  +  Kt-ljUk  +  bn _ 

{juk)n  -  ai{juk)n~l  -  a2(juk)n~2  -  ....  -  an-i(juk)  -  an ' 
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Cross-multiplying  and  reducing  creates  a  linear  equation  from  which  the  unknown 
coefficients  a,  and  6;  can  be  obtained. 


Ak  +  jBk  —  Ak  +  jBk){juik)  1a-i  +  $>*)  lbi 


i=  1 


1=1 


(12) 


Expanding  the  equation  gives 


Ak  +  jBk  — 


1, ,  . .  1  1  1  1  N 

-{Ak  +  jBk){ — ai - ja3  4 — g-a5 - ja7  +  ...) 


<-Ok 


cot 


cot 


COi 


1, 1 L  1  ,  1 . 
+-(— 6i  —  -jfa  4 — 7-05 


1 


J  COk 


w 


cot 


LO 


jb7  + ...) 


1 


1 


+  {Ak  4-  jBk){ - 2  a2  ^ - 4  a4 - 6  a6  ■*”  •■■) 


(J 


col 


cot 


,  1 ,  1 ,  1 ,  \ 

+  ( - 2^2  4 - 4^4 - g06  4"  •••)• 


cot 


col 


cot 


(13) 


Multiplying  both  sides  by  j  and  expanding,  we  are  able  to  match  the  real  and 
complex  portions  of  the  right  hand  side  the  equation  with  the  left.  This  will  allow 
us  to  solve  for  the  unknown  coefficients: 


-Bk  = 


.  ,  1  1  1  1  x 

Ak{ — ai - 5-03  4 - Ka5 - 7a7  4"  •••) 

,  1  1  1  . 
+Bk{— oa2 - 4O4  4 - gQ6  —  •••) 


cot 


col 


cot 


,  1 ,  1  1 , 
4-( — b\ - ^-03  4 — j;b5 


1 


col 


col 


UJ 


7b7  4-  ...) 


Ak  = 


COk 

,  1  1  1  1  , 

Bk\  —  d  1 - 3^3  +  ~ 5a5 - 7a7  4-  ...j 


COk 


col 


'k 

.  ,  1  1  1  V 

4-j4fc( - o°2  "I - 4a4 - 6°6  •••) 


COl 


cot 


' k  u k  wk 

,  1 1  1 ,  1 ,  x 
+  ( - 2  ^2  H - 4^4 - 6^6  + 


OJt 


(14) 


For  an  nth  order  SISO  system,  the  control  system  is  specified  by  2n  parameters. 
For  this  reason,  we  chose  n  sinusoidal  test  functions,  each  one  producing  2  equations. 
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2.2.1  Second  Order  Example.  Given  the  transfer  function  [22] 


H(s) 


s2  +  2(u;ns  +  u 2 


Knowing  that  we  can  measure  the  output  phasor,  the  unknown  parameters,  (  and 
ajn,  can  be  solved  using  the  technique  described  in  Eqs.  (11)-(14): 


A  +  jB  = 


-or 


cat. 


+  2Ciu>nju)  +  ui 


2  ’ 
n 


Cross-multiplying  and  simplifying  yields 


{A  +  jB)(ul  -uj2+  2 (unju)  =  u2n 


which  implies 

(A  —  —  2Bco(u)n  —  Aco2  +  "h  —  Buj2 )  =  0. 

Separating  the  imaginary  and  real  terms  yields 

(A  —  l)o;£  —  2  Bu(u>n  =  Alo2 
Bu^  +  2Aui(un  =  Bu2. 

Solving  for  natural  frequency  and  damping  ratio,  the  unknown  parameters,  yields 

I  A2  +  B2 

Un  ~  \A2  +  B2-AUJ 

c  =  g 

2x/(Ai  +  W2  -  A)  (£>  +  W) 

Recall,  A  and  B  are  coefficients  of  the  output  phasor  and  can  be  directly  measured. 
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2.3  Stochastic  Analysis 

A  goal  of  system  identification  is  to  find  a  “best  fit”  model  of  the  system 
being  analyzed  [19] .  The  stochastic  analysis  acknowledges  the  noise  in  the  measured 
input  and  output  data.  Using  a  least-squares  approach,  the  sum  of  the  squared 
errors  between  the  true  output  of  the  model  and  the  measured  output  is  minimized. 
Using  the  least-squares  approach  and  stochastic  modeling,  large  errors  and  poor 
measurements  are  given  less  weight  than  more  accurate  measurements.  The  use  of 
digital  signal  processing  requires  that  our  once-continuous  system  is  now  discretized. 

In  the  case  of  a  dynamic  system,  a  system  output  can  be  described  as  [8,  19,  22] 

Vk+ 1  =  Vk  +  a2Vk-l  +  ••••  +  O-nVk-n+1  +  b\  uk  +  ^2uk-\  +  +  bmuk-m+ 1  (15) 


and  the  measurement  equation  as 


Zfc+1  =  Vt+l  +»!+!,  VM£N(0,<T2) 


(16) 


or 


Vk  =  Zk-  vk 


(17) 


which  may  contain  process  and  disturbance  noise.  Therefore, 

Zk+ 1  —  Vk+ 1  =  0,\{zk  —  Vk)  +  Q^{Zk-\  —  Vk- 1)  +  ....  +  an(Zk-n+ 1  —  ^fc-n+l) 

+b\Uk  +  byUk-i  +  ....  +  bmUk-m+ 1-  (18) 


By  defining  a  noise  vector,  I4+i,  we  can  rearrange  the  above  equation  as 


Zk+ 1  —  O'lZk  +  a2Zk-i  +  ....  +  anZk~n+ 1  T  b\Uk  +  b2Uk~i  +  ....  +  bmUk-m+i  + 14+ 1  (19) 


where 


14+i  —  Vk+ 1  —  a-iVk  —  a-nik-i 


Q'n'Vk— n+1  * 


(20) 
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Now,  the  measurement  equation  is  defined  as 


Z  =  HQ  +  V ,  E{VVt )  =  R 


(21) 


where 


Z  = 


(  Zk+l  ^ 
2fc+ 2 


Y  Zk+N+l  J 


,  e  = 


(AH-l)xl 


t  O 


61 


y  ^rn  J 


(  Vk+ 1  ^ 
Vfc+2 


\  ^4+Af+l  ) 


(22) 


(AH-l)xl 


(m+n)  xl 


and 


( 


H 


Zk  Zk— 1 
^fc+1 


^fc— n+1  'U'k  'U'k—l  *  ’  *  ^k— m+1 

^fc—n+2  ^fc+1  uk  *  *  *  ^/c— m+2 


\ 


\  2fc+JV  Zfc+jV-l  **•  ^fc+A^-n+l  ^fc+7V  ^/c+JV-1  ***  /  (jv+ l)x  (m+n) 

(23) 

In  this  notation,  rn  is  the  number  of  measurements  and  n  is  the  number  of 
parameters  to  be  identified.  We  can  now  find  the  Least  Squares  estimate,  0,  and 
the  estimation  error  covariance  matrix  P  [2,  22]. 

The  Least  Square  estimate  is 


0  =  ( hth)-1htz 


(24) 


and  the  parameter  estimation  error  covariance  is 


P  =  (t2(HtH)~ 1 


(25) 
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So  far,  the  measurement  and/or  process  noise  has  not  been  taken  into  account 
properly.  A  more  rigorous  method  would  be  to  solve  for  the  parameter  estimates 
using  a  weighted  pseudo-inverse  to  account  for  noise  in  the  system.  The  minimum- 
variance  estimate  is  [4,  5]: 


eMV  =  (. HTR7lH)-lHTR7lZ  (26) 

and  the  minimum-variance  estimation  error  is 

Pmv  =  (HTR~lH)~l  (27) 

where  R  is  the  weighting  matrix. 

Eq.  (24)  calculates  the  parameter  estimates  using  an  unweighted  pseudo¬ 
inverse.  This  is  possible  when  the  weighting  matrix,  R ,  is  assumed  to  be  a  scaled 
unity  matrix,  viz.,  when  cross-correlation  does  not  exist  and  all  scalar  noises  have 
the  same  variance.  When  this  assumption  is  made,  R  =  cr2/,  where  I  is  the  identity 
matrix  and  a2  the  variance  of  the  noise,  drops  out  of  the  parameter  estimate  equation 
and  only  a2  enters  the  calculated  parameter  estimation  error  covariance  matrix. 

2-4  Calculating  R 

R  is  affected  by  the  noise  created  by  our  sensors  when  measuring  the  output 

of  the  system.  Many  times,  R  is  represented  as  a  diagonal  matrix  with  cr2  along 

the  diagonal  and  zeros  in  the  off-diagonal  spaces,  which  implies  no  cross-correlation. 
This  is  often  deemed  adequate,  knowing  that  each  output  has  its  own  independent 
sensor  to  take  measurements.  In  truth,  the  measurement  noises  are  correlated  and 
the  sensors  are  coupled  to  some  extent  [22],  and  this  causes  off-diagonal  terms  in  the 
R  matrix.  Earlier,  in  Eq.  (5),  we  described  R  as  being  the  expected  value  of  the 
measurement  noise  times  the  transpose  of  that  noise.  It  is  shown  from  Eq.  (22)  that 
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the  measurement  noise  is  actually  a  noise  vector,  V.  This  noise  vector  now  produces 
off-diagonal  terms  in  the  R  matrix. 

The  matrix  R,  using  a  two  parameter  estimation  problem  example,  is  now 
defined  as 


R  = 


E{VVt)  =  E 

(  ( 


E 


(  (  Vfc+i  ^ 


y  Vk+N  J 

\ 


\ 


f  14+i  ■  •  •  f4+jv  J 


=  E 


^fc+i  vk 
Vk+2  ~  alvk+l 


\\  Vk+N  ~  UlVk+N-1  ) 

Vk+i  —  a\Vk  Vk+2  —  aiVk+i  ■  Vk+N  ~  aiVk+N-i 

(  (ufc+1  -  aivk)  (vk+ 1  -  aivk)  (vk+i  -  axvk)  ( vk+2  -  o,\Vk+\) 
(ufc+2  -  aiVk+i)  (vk+i  -  axvk)  (vk+2  -  axvk+ 1)  (vk+ 2  -  axvk+i) 


V 


\ 


(  a2  +  a2  a2 


-aa 

0 

0 


-aa 


a2  +  a2  a2 


-aa 

0 


—aa 


a2  +  a2a2 


-aa 

0 


0 

0 

—aa2 
a2  +  a2a2 
—aa2 


\ 


(28) 
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Finally, 


R 


1  +  q ?  — a 

0 

—  CL  1  -j -  0? 

—a 

0  —a 

1  “b  d 

V  :  ;  ■■  ■■) 

a2R. 


Now,  Eqs.  (26)  and  (27)  become 

%MV  =  (. HTR-lH)-1HTR~lZ 
Pmv  =  ct2{HtR-1H)-\ 


(29) 


(30) 


(31) 

(32) 


Note  that  the  intensity  of  noise,  a,  does  not  affect  the  parameter  estimate  Qmv- 

In  summary,  the  parameters  of  an  unknown  dynamic  system  can  be  identified 
by  using  a  sinusoidal  test  function  as  an  input  to  that  unknown  plant  and  observing 
the  phasor  output.  However,  care  must  be  taken  not  to  over-model  the  unknown 
plant.  When  noise  is  included  in  the  system  dynamics,  a  stochastic  analysis  of  the 
measurement  situation  must  be  performed  to  account  properly  for  the  effects  of  noise. 
A  discrete-time  plant  model  was  also  discussed  and  the  input  and  measurement 
equations,  now  with  a  noise  term,  were  defined  .  It  was  then  shown  how  the  strength 
of  the  noise  can  be  represented  as  a  weighting  matrix,  R ,  and  applied  to  the  least 
squares  formula,  to  provide  more  accurate  parameter  estimates. 
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III.  Stochastic  Modeling 


A  Kalman  filter  is  a  data  processing  algorithm  that  uses  all  available  data, 
such  as  plant  model,  initial  conditions,  and  statistical  descriptions  of  any  biases, 
measurement  noise  or  process  noise  [15,  16].  This  information  is  fed  into  the  propa¬ 
gate/update  algorithm  which  then  optimally  derives  an  estimated  value  for  the  sys¬ 
tem’s  state  in  a  way  that  minimizes  estimation  error  variance.  The  rigorous  Kalman 
filtering  paradigm  for  linear  systems  can  be  extended  to  provide  an  estimate  of  the 
control  matrix  B.  Our  main  result  is  the  following  system  identification  algorithm. 

3.1  System  Identification  Algorithm 

Since  digital  signal  processing  is  used,  a  discrete-time  dynamical  model  consid¬ 
ered  in  this  work  is  used.  The  loop  gain  system  identification  algorithm  is  developed 
by  Sillence  [26]  and  is  concisely  presented  in  Theorem  1. 


Theorem  1  Consider  the  following  linear  estimation  problem.  The  linear  dynamical 
system  is 


xk+1  =  Axk  +  Kbuk  +  Twk,  E(wkwl)  =  Q,  k  =  0, 1, ....,  N  -  1  (33) 

the  prior  information  is 

x0  e  N(x0,P0x)  (34) 

K  G  N(K0,P0k)  (35) 


the  output  signal 


yk+ 1  =  Cxk+ 1 


(36) 
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and  the  observation  equation  is 


Zk+ 1  —  Uk+ 1  +  Vk+l,  E(vk+ l't'fe+i)  —  R- 


(37) 


The  matrices  A,  b,  C  and  F  are  known.  The  respective  Gaussian  zero  mean  process 
noise  and  measurement  noise  covariance  matrices,  Q  and  R,  are  also  known.  The 
open-loop  gain  K  is  not  known. 


Denote  by  xk  and  Kk  the  respective  estimates  of  the  state  xk  and  the  loop  gain 
K  at  time  k,  given  the  measurements  record  z\, Zk,  the  input  sequence  uq,  ...,uk_x, 
and  the  prior  information  on  x o  and  K .  The  covariance  of  the  estimation  error  of 

vector  is  denoted  by  the  partitioned  matrix  Pk  = 


Xq  *£(); 


K0  =  K0,  P0xx=P0x 


Po, 


—  P( 


Ok  ; 


P0xK  =  0. 


(38) 


Then,  for  k  =  0, 1, N  —  1,  the  state  and  gain  estimates  are  updated  as  follows 

xk+i  =  Axk  +  I<kbuk  +  Kx(zk+ 1  -  CAxk  -  KkCbuk)  (39) 

Kk+i  =  Kk  +  KK(zk+i  —  CAxk  —  KkCbuk )  (40) 

where  the  Kalman  gains 

Kx  =  {APkxxATCT  +  uk[ApkxK{Cb)T  +  b(CApkxK)T] 
WkpkKKb{Cb)T  +  TQTtCt)  x  {CAPkxxATCT 
+uk[CAPkxK(Cb)T  +  (. Cb){CApkxK)T } 

WkPkKK  ( Cb){Cb)T  +  CTQTtCt  +  R}-1  (41) 
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and 


Kk  =  {(CApk,K)T  +  utptKK(Cb)T]x{CAPkx,ATCT 
+uk[CApklK(Cb)T  +  {Cb)(CApklK)T] 

+nlPkKACb)(Cb)T  +  crQrTcT  +  r}~ (42) 

Furthermore,  the  estimation  error  covariances  are 

Pk+ ixx  =  {[APkxxAT  +  uk{ApkxKbT  +  bp[xKAT)} 

+u2kpkKKbbT  +  rgr^-1  +  ctr-1c}~1  (43) 

Pk+ 1KK  =  PkKK  -  [( CApkxK)T  +  ukpkKK(Cb)T ]  x  {CAPkxxATCT 
+uk[CApkxK(Cb)T  +  (( Cb)(CAPkxK)T } 

+u2kpkKK(Cb)(Cb)T  +  CYQYTCT  +  R}~1 
x  [(CApkxK )  +  ukPkKK  (Cb)]  (44) 

Pk+ ixK  =  A pkxK  +  ukpkKKb  -  {APkxxATCT  +  uk[ApkxK{Cb)T  +  b(CApkxK)T ] 
+u2kpkKKb(Cb)T  +  YQYtCt} 

x{CAPkxxATCT  +  uk[CApkxK  (Cb)T  +  {Cb)(C  APkxK)T) 
+u2kPkKK(Cb)(Cb)T  +  CYQYtCt  +  R}-1 

x[(CApkxK)  +  ukPkKK(Cb)}.  (45) 

□ 
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3.2  Proof  of  Theorem  1 


We  shall  require  the  complete  Matrix  Inversion  Lemma  (MIL) 

Lemma  2  Assume  the  relevant  matrices  are  compatible  and  invertible.  Then 

(Ai  —  A2A4 *^.3)  =  A1 1  +  Ai  1A2  ( A 4  —  A^A1 1  Af)  A^A1 1-  (46) 

□ 

Since  the  unknown  loop  gain  is  a  constant,  we  augment  the  dynamics  as  follows. 

Kk+ 1  =  Kk.  (47) 

Hence,  the  augmented  state  dynamics  evolve  in  3in+1  and  are 


and  the  measurement  equation  is 

zk+ 1  =  (  C  :  0  )  ^  |  +vk+i.  (49) 

As  can  be  seen,  the  equations  are  similar  to  that  of  the  deterministic  model  except 
for  noise  now  being  modeled  into  the  system.  Here,  the  wk  and  vk+i  represent  the 
process  noise  and  measurement  noise,  respectively.  The  covariances  of  these  noises 
are  represented  by  Q  and  R  in  the  stochastic  model.  The  values  of  Q  and  R  were 
defined  in  Chapter  1. 

The  prior  information  at  time  instant  k  is 


where 


^fc+1 

Kk+ x 


Axk  +  Kkbuk 

Kk 
- - - 

Axk  “I-  Kkbuk 
Kk 


+  K  ^fc+i  —  ^  C  :  0  ) 

+  K  (zk+ 1  -  CAxk  -  ukKkCbj 


Axk  +  Kkbuk 
Kk 


(55) 


where  the  Kalman  gain 


K  = 


^  APkxxAT  +  uk(ApkxKbT+ 

bpTkAT)  +  uiPkKKbbT  +  rQrT 


\ 


ApkxK  +  ukpkKKb 


V 


pLkAT  +  UkPkKKbT 


Pkh 


X 


/ 


cT 


X 


{CAPk„ATCT  +  u„  [CAp„,K(Cb)T  +  ( Cb)(CApk,K)T ] 


+'j't.pt,:K<'.CL)icb)'r  +  ctqttct  +  i?}'1 

t  APk„ATCT+uk  [Apk,K(Cb)T  +  b(CApk,Kf 
WkpkKKb(Cb)T  +  [<vrTr;T 


\ 


V 


(C/lpt,K)T  +  «tptKlt(CT)’ 


X 


Finally, 


{04PfcllJ4TCT  +  uk  [CApkxK(Cb)T  +  ( Cb)(CAPkxK)T } 
WkpkKK{Cb)(Cb)T  +  cr<5rTcr  +  p}"1 . 

—  Pk(x,K)  ~~  K  ^  C  :  0  )  Pfc(X)K)  ■ 


(56) 


(57) 


22 


Hence,  we  calculate 


fc+l(x,K) 


^  APkxx  AT  +  uk  {ApkxK  bT + 

bplKAT)  +  ulpkKKbbT  +  TQTT 


ApkxK  +  ukpkKKb  \ 


\ 

( 


VIXKAT  +  ukPkKKbT 


PkKK  ) 


[APkxxATCT  +  uk 


ApkxK(Cb)T  +  b(CAPkxK)T 


+ukPkKKb(Cb)T  +  TQTtCt} 
x  {CAPkxxATCT  +  uk  [CAPkxK(Cb)T  +  (< Cb)(CAPkxK)T ] 
WkpkKK{Cb)(Cb)T  +  CTQTtCt  +  R}~1  x  [CApkxxAT 
+uk  ( CAPkxKbT  +  CbApTkxKAT )  +  u\pkKKCbbT  +  CTQTt] 


\ 


{CApkxK)T  +  ukpkKK  {Cb)T 


x  {CAPkxxATCT  +  uk  [CAPkxK(Cb)T  +  (< Cb)(CAPkxK)T } 
WkpkKK{Cb){Cb)T +  CTQTtCt +  R}~1  x  [CAPkxxAT 
+uk  ( CApkxKbT  +  CbApTkxKAT)  +  ulPkKKCbbT  +  CTQrr] 


|  APkxxATCT  +  uk  ApkxK  ( Cb)T  +  b  ( CApkxK ) 


WkPkKKb(Cb)T  +  TQTtCt) 
x  {CAPkxxATCT  +  uk  [CAPkxK(Cb)T  +  (< Ob)(CApkxK)T ] 
+y2kPkKK{Cb)(Cb)T  +  ctqttct  +  Ry1 


x  ( CApkxK  +  ukpkKKCb ) 


\ 


(CApkxK)T  +  ukpkKK  (Cb)T 

x  { CAPkxxATCT  +  uk  [CAPkxK(Cb)T  +  (Cb){C ApkxK)T] 
WkpkKK{Cb){Cb)T  +  CTQTtCt  +  R}~ 1 

x  (< CApkxK  +  ukpkKKCb)  J 

(58) 


23 


Thus, 


Pk+ ixx  =  [A  PkxxAT  +  uk(ApkxKbT  +  bpTkxKAT )  +  u2kpkKKbbT  +  TQrT] 

x  { [- APkxxAT  +  uk{ApkxKbT  +  bpTkxKAT)  +  u2kpkKKbbT  +  TQTr] _1 
-CT  {CAPkxxATCT  +  uk  [CAPkxK(Cb)T  +  (Cb)(CAPkxK)T} 
+u2pkKK(Cb)(Cb)T  +  CTQYtCt  +  R}~ 1 C } 
x  [APkxx  AT  +  uk(ApkxK  bT  +  bpTkxK  AT)  +  u\pkKK  bbT  +  TQTt]  .  (59) 

Next,  apply  the  MIL  (Lemma  2)  to  the  expression  in  the  outer  curly  brackets 
from  Eq.  (59),  viz., 

|  [APkxxAT  +  uk(ApkxKbT  +  bpkxKAT)  +  u2kpkKKbbT  +  TQrT] 

-CT  {CAPkxxATCT  +  uk  [CAPkxK(Cb)T  +  (< Cb){CAPkxK)T ] 
+u2PkKK(Cb)(Cb)T  +  CTQrrCr  +  R}-1  cyl 

where  we  set 

Ai  =  [APkxxAT  +  uk{ApkxKbT  +  bplxKAT)  +  u2kPkKKbbT  +  TQTt}  1 

a2  =  CT 

A3  =  C 

A4  —  {CAPkxxATCT  +  uk  [CApkxK(Cb)T  +  (Cb)(CApkxK)T'\ 
+u2kPkKK(Cb)(Cb)T  +  CTQTtCt  +  R} 


24 


we  obtain 


{ [APk„AT  +  uk(Apk,KbT  +  bplKAT)  +  u\pkl<KbbT  +  rQrT] 

-CT  {CAPk„ATCT  +  uk  \CApk,K{Cb)T  +  (Cb)(CApk,K)T] 
+4ptKACb)(Cbf  +  crQTTcT  +  R}-1  c}"1 
=  [APk„AT  +  uk(ApkxKbT  +  bplKAT)  +  utpkKKbbT  +  r<?rT] 

+  [APk„AT  +  uk(ApkxKbT  +  bplKAT)  +  ulpkltKbbT  +  r«rq  CT 
x  {{CAPk„ATCT  +  uk  [CApk,K(Cb)T  +  (Cb)(CApkxK)T] 

+u\pkKK{Cb){Cb)T  +  crgrTcT  +  r} 

-C  [APkxxAT  +  uk(ApkxKbT  +  bplxKAT )  +  u2kpkKKbbT  +  rQrT]  CT} 
xC  [APkxxAT  +  uk(APkxKbT  +  bpTkxKAT )  +  ulPkKKbbT  +  rgrr] . 

Reducing  the  above  gives 

[APkxxAT  +  uk(ApkxKbT  +  bplxKAT )  +  u\pkKKbbT  +  r(?rT] 

X  { [APk„AT  +  uk(Apk,KbT  +  bplKAT )  +  ulpkKKbbT  +  r«rT]  ■'  +  ctr-'c} 
x  [APk„AT  +  uk(ApkrKbT  +  bplKAT)  +  ulpkKKbbT  +  ror7'] . 

Hence,  Eq.  (59)  can  now  be  reduced  to 

fUi„  =  {[APt,,AT  +  ut(APk,y  +  bplKAT)  +  ulptKKbbT  +  rQTTp 

+CtR-1C}~1.  (60) 
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In  addition 


Pk+lKK  ~  PkKK  d-  UkPkKK  {Cb)  ] 

X  {CAPkxxATCT  +  uk  [CApkxK(Cb)T  +  ( Cb)(CApkxK)T } 
+u2pk]</<{Cb)(Cb)T  +  CTQTtCt  +  Ryl  ( CAPkxK  +  ukPkKKCb) 

(61) 


Pk+ ixK  =  ApkxK  +  ukpkKKb  -  [APkxxAT CT  +  uk  [ApkxK(Cb)T  +  b(CApkxK)T] 
WkPkKKb(Cb)T  +  TQTtCt} 

{CAPkxxATCT  +  uk  [CAPkxK{Cb)T  +  (( Ob)(CAPkxK)T ] 
+u2kPkKK(Cb)(Cb)T  +  CTQTtCt  +  R}~ 1  (CAPkxK  +  ukVkKKCb ) .  (62) 


We  also  partition  the  Kalman  gain  vector  as  follows 


K  = 


(63) 


where 


Kx  =  {APkxxATCT  +  uk  [ApkxK ( Cb)T  +  b(CApkxK)T] 

+ukPkKKb{Cb)T  +  TQTtCt} 

x  { CAPkxxATCT  +  uk  [CAPkxK{Cb)T  +  (Cb)(CAPkxK)T] 
+u2kpkKK(Cb)(Cb)T  +  CTQTtCt  +  Ry1  (64) 
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and 


Kk  =  [{CApt,K)T  +  utpkKK(Cb)T] 

x  {CAPk„ATCT  +  ut  [ CApk,K(Cb)T  +  (Cb){CApkxK)T] 
+ubk,<K(Cb)(Cb)T  +  CTQTtCt  +  fi}"‘ .  (65) 

Hence,  we  finally  obtain 

£fc+i  =  Axk  +  Kkbuk  +  Kx(zk+ 1  —  CAxk  —  K^Cbuk)  (66) 

Kk+1  =  Kk  +  KK(zk+1-CAxk-KkCbuk).  (67) 

□ 


Proposition  3  An  additional  application  of  the  MIL  will  reduce  the  number  of  ma¬ 
trix  inversions  such  that  only  the  low- order  matrix 


CAPt„ATCT  +  uk  \CApkxK{Cb)T  +  (Cb)(CApk, Kf\ 
+ulpkkACt’)(Cb)T  +  CTQTtCt  +  R 


needs  to  be  inverted. 


□ 


3.3  Discussion 

It  is  important  to  realize  that  the  absence  of  complete  plant  information,  viz., 
the  uncertainty  in  the  loop  gain  parameter  K,  causes  both  the  parameter  and  the 
state  estimation  error  covariances  to  be  dependent  on  the  input  signal  -  see,  e.g., 
the  covariance  equations  (43)-(45)  in  Theorem  1.  This  is  a  major  departure  from 
the  classical  state  estimation  paradigm  in  linear  control  theory.  Thus,  the  loop  gain 
estimate  K  (and  also  the  loop  gain  estimation  error  covariance)  are  now  control- 
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dependent.  Obviously,  the  best  loop  gain  estimate  is  obtained  at  the  end  of  the 
estimation  interval,  at  time  N.  In  addition,  the  algorithm-provided  loop  gain  and 
state  estimates  are  correlated.  Furthermore,  the  loop  gain  and  state  estimates’  de¬ 
pendence  on  the  input  signal  is  nonlinear.  The  input  signal  dependence  of  the  loop 
gain  and  state  estimation  error  covariances,  is  a  unique  manifestation  of  the  dual  con¬ 
trol  effect.  This  means  that  the  estimation  error  variance  is  dependent  on  the  input 
signal,  which  is  not  the  case  in  classical  linear  state  estimation/Kalman  filtering. 

3.3.1  Example  1.  Consider  the  classical  Kalman  Filter  paradigm  where 
the  loop  gain  K  is  known,  i.e.,  K  =  1.  In  this  special  case 


PoKK  =  0,  PoxK  =  0,  PkKK  =  o,  PkxK  =  0 


for  all  k  =  1, 2, 3, .... 


and  it  follows  that 


Pk 


Pk 


xx 


Kk 

Kx 


(APt„AT  +  TQTt)Ct 
x  (CAPl„ATCT  +  CTQTtCt  +  R)  1 
\(APk„AT  +  rQrTyl  +  cTir1cY1 


Thus,  the  classical  Kalman  filter  formulae  are  recovered. 


Remark  4  If  xq  is  known,  viz.,  xq  <E  N  (xo,0),  i.e.,  Pqx  =  0,  and  only  the  loop  gain 
parameter  K  is  not  known,  i.e.,  Pqxx  =  0,  PoxK  —  0,  one  nevertheless  has  to  deal 
with  an  uncertain  x  at  time  k  (even  ifT  =  0  and  if  there  is  no  process  noise)  and 


one  must  propagate 


Xk 

Kk 


and  Pk 


(n  +  l)x(n  +  l)  ' 


□ 
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3. 3. 2  Example  2.  Special  case:  C  is  a  row  vector  (i.e. ,  a  scalar  measurement 
is  being  used),  then  the  estimation  algorithm  is 

*xk-\-\  —  Axk  Kkbuk  CAxk  KkCbzik'j 

Kk+ 1  —  Kk  +  Kxizk+i  —  CAxk  —  KkCbuk ) 


where  the  Kalman  gain  for  state  estimation  is 


K ,  =  ±  {APk„ATCT  +  ut{(Cb)Apt'K  +  (CAPt'K)b\ 


+ul(Cb)PkKKb  +  rQTTcT} 


and  where  the  scalar  X  is  given  by 


X  =  CAPkxxATCT  +  2ukCbApk, 


+ui(Cb)PkKK  +  CYQTtCt  +  R 


The  Kalman  gain  for  loop  gain  estimation  is 


Kk  = 


[CApkxK  +  ukCbApkKK 


X 


Finally,  the  estimation  error  covariances  are 


Pk+ 1«  =  { [APkxxAT  +  uk{ApkxKbT  +  bplxKAT )  +  u2kpkKKbbT  +  TQTt] 


T1  -1 


4cTc 


-i 


Pk+lKK 

Pk-\- \XK 


=  PkKK  ~ 


[CApkxK  +  ukCbApk 


X 


ApkxK  T  ukpkKKb 


[ CApk xK  +  UkCbApk 

kk] 

X 


x  {APkxxATCT  +  uk  \{Cb)APkxK  +  (CApkxK)b) 
+ul(Cb)PkKKb  +  VQTTCT}  . 
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In  summary,  a  system  identification  algorithm  was  developed  to  identify 
system’s  loop  gain,  K. 


IV.  Adaptive  Parameter  Smoothing 

In  conventional  indirect  adaptive  control  a  two-module  controller  consisting  of  a 
compensator  and  a  system  identification  module  is  used.  The  compensator  is  syn¬ 
thesized  on-line  using  a  model-based  controller  design  methodology.  The  system 
identification  module  provides  the  plant  parameter  estimate.  The  latter  is  used  in 
the  on-line  compensator  synthesis  algorithm  to  update  the  plant  model  and  thus 
modify  the  compensator  accordingly,  which  yields  adaptive  control  action.  There 
is  a  tendency  to  rely  on  assumed  certainty  equivalence  and  directly  insert  the  pa¬ 
rameter  estimate  into  the  compensator  synthesis  formula.  This  course  of  action  is 
to  a  large  extent  motivated  by  the  classical  solution  of  the  LQG  problem  in  which 
an  LQR  state  feedback  compensator  is  used  in  tandem  with  a  Kalman  filter  which 
provides  the  state  estimate  [17]. 

At  this  point  it  is  worthwhile  to  recall  the  LQG  paradigm  momentarily:  the 
plant  is  linear  and  known  and  the  cost  functional  is  quadratic  in  the  state  and  con¬ 
trol  signals.  The  state  estimation  problem  for  linear  control  systems  with  known 
dynamics,  control  and  observation  ( A ,  B,  C )  matrices  resides  in  the  realm  of  lin¬ 
ear  regression,  and  therefore  the  Kalman  filter  solution  of  the  minimum  variance 
state  estimation  problem  yields  an  unbiased  estimate  of  the  state.  An  LQR  com¬ 
pensator  directly  operates  on  the  Kalman  filter-provided  state  estimate,  viz.,  the 
LQR  compensator  is  used  in  tandem  with  the  Kalman  filter.  The  LQG  controller, 
which  consists  of  two  modules,  the  Kalman  filter  and  the  fixed  LQR  compensator, 
is  optimal. 

Our  plant,  specified  in  Eqs.  (1)  -  (5),  is  linear,  however  it  contains  the  un¬ 
known  parameter  K  which  quantifies  the  degree  of  control  power  loss  in  the  control 
effector.  Thus,  the  state  and  the  plant  parameter  K  are  to  be  jointly  estimated.  It 
is  remarkable  that  also  our  system  identification  algorithm,  as  stated  in  Theorem  1, 
yields  an  unbiased  state  and  parameter  estimate  and  a  reliable  predicted  estimate 
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error  covariance.  Moreover,  in  the  special  case  where  PoKK  =  0  and  Kq  =  1,  viz.,  the 
parameter  is  known  and  therefore  the  (linear)  plant  is  completely  known,  the  clas¬ 
sical  Kalman  filter  state  estimation  formulae  are  recovered  -  see,  e.g.,  Example  1  in 
Chapter  3.  Indeed,  our  derivation  of  the  system  identification  algorithm  is  rigorous 
and: 

•  The  estimate  is  unbiased. 

•  The  predicted  covariance  of  the  estimation  error  is  reliable. 

In  addition,  it  is  noteworthy  that  when  the  plant  is  completely  known  and  one 
is  exclusively  interested  in  the  state  estimate,  as  is  the  case  in  the  classical  Kalman 
filtering  paradigm,  the  quality  of  the  state  estimate,  viz.,  the  predicted  covariance 
of  the  state  estimation  error,  is  not  dependent  on  the  plant  input.  Indeed,  the 
covariance  of  the  state  estimation  error  is  not  used  in  the  LQG  controller.  However, 
in  the  adaptive  control  case,  where  the  plant  parameter  K  is  not  known,  the  predicted 
state  and  parameter  estimation  error  covariance  are  dependent  on  the  plant  input 
-  see,  e.g.,  Eqs.  (43)  -  (45).  Thus,  in  adaptive  control,  the  quality  of  the  state  and 
parameter  estimate  is  dependent  on  the  input  signal.  Evidently,  when  the  predicted 
estimation  error  covariance  is  small,  the  quality  of  the  parameter  estimate  is  good, 
and,  conversely,  when  the  predicted  estimation  error  covariance  is  large,  we  cannot  be 
certain  about  the  true  value  of  the  parameter  and  the  system  identification  algorithm- 
provided  parameter  estimate  might  be  far  from  the  true  parameter.  Thus,  the  control 
signal-dependence  of  the  quality  of  the  parameter  (and  state)  estimate  motivates 
one  to  refer  to  the  excitation  quality  of  the  control  signal.  Good  excitation  yields  a 
predicted  parameter  estimate  error  variance  which  is  small,  and  thus  is  conducive  to 
a  well  designed  parameter  estimation  experiment. 

The  following  is  crucial.  In  our  specific  situation  where  the  system  identifica¬ 
tion  algorithm  is  rigorously  derived,  an  unbiased  state  and  parameter  estimate  and 
a  reliable  computed  (predicted)  estimation  error  covariance  are  obtained.  Hence, 
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the  excitation  quality  is  indeed  directly  reflected  in  the  size  of  the  predicted  state 
and  parameter  estimation  error  covariance.  In  other  words,  we  have  a  direct  mea¬ 
surement  of  the,  otherwise  somewhat  nebulous,  degree  of  excitation  -  it  is  given  by 
the  size  of  the  computed  parameter  estimation  error  variance,  provided  the  latter 
is  reliable,  which,  in  our  case,  it  is.  Indeed,  the  importance  of  the  computed  para¬ 
meter  estimation  error  variance  being  reliable  cannot  be  overestimated.  When  an 
erroneous  computed  estimation  error  variance  is  used  in,  e.g.,  state  estimation,  the 
state  estimate  becomes  “biased”  and  one  then  refers  to  filter  divergence.  This  is 
a  common  occurrence  in  extended  Kalman  filtering  [16,  17].  Our  work  hinges  on 
the  computed  parameter  estimation  error  variance  being  reliable,  by  virtue  of  the 
rigorous  system  identification  algorithm  developed  in  Chapter  3. 

Now,  the  dependence  of  the  quality  of  the  system  identification  algorithm- 
provided  parameter  and/or  state  estimate  on  the  control  signal  is  the  root  cause 
of  the  dual  control  effect  observed  in  nonlinear  stochastic  control  and  in  adaptive 
control  [17].  When  the  straightforward  assumed  certainty  equivalence  principle 
is  used  in  adaptive  control,  the  dual  control  effect  is  responsible  for  the  bursting 
phenomenon  often  observed  in  adaptive  control  [1,  17].  This  then  invalidates  the 
applicability  of  assumed  certainty  equivalence  outside  the  very  circumscribed  LQG 
paradigm,  where  the  quality  of  the  estimate  is  not  dependent  on  the  control  signal 
and  the  separation  principle  upon  which  certainty  equivalence  hinges  is  rigorously 
proven. 

4 . 1  Fixed-  Weights  Parameter  Filter 

Evidently,  when  the  estimation  error  variance  is  large,  due  to  low  excitation, 
and  in  the  absence  of  a  Separation  Theorem  [1, 12,  25,  27],  we  are  not  encouraged  to 
boldly  insert  the  new  plant  parameter  estimate  into  the  compensator  synthesis  equa¬ 
tion.  Indeed,  when  the  parameter  estimation  error  variance  is  large,  measurement 
noise  will  cause  the  parameter  estimate  to  vary  wildly  from  window  to  window,  as 
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Step  response  of  1st  order  low-pass  filter.  Time  constant  is  0.1  second. 


Figure  2.  Step  response  of  1st  order  low-pass  filter.  Time  constant  is  0.1  second. 

observed  in  the  simulation  experiments  in  Figure  26.  Since  in  the  conventional  adap¬ 
tive  control  paradigm  the  parameter  is  stipulated  to  vary  “slowly” ,  we  realize  that 
the  system  identification  algorithm-provided  parameter  estimates  may  be  far  from 
their  true  value.  This  then  motivates  us  to  smooth  the  parameter  estimate,  viz.,  to 
pass  the  parameter  estimate  through  a  fixed  low-pass  filter.  This  obviously  removes 
the  fluctuations  in  the  parameter  estimate,  viz.,  it  removes  the  deleterious  effects 
of  noise,  and  by  doing  so,  provides  a  better  parameter  estimate  to  be  subsequently 
used  in  the  compensator  synthesis. 

Consider  the  following  first-order  filter  modeled  by  the  scalar  continuous-time 
state  equation: 

x(t)  :  ——x(t)  +  —  u(t)  (68) 

r  r 

Since  our  sampling  time  is  0.01  seconds,  the  required  time  constant  is  about  r  =  0.1. 
Figure  2  shows  that  this  low-pass  filter  can  smooth  out  the  edge  of  the  input  signal. 
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Now,  the  discretized  low-pass  filter  of  Eq.  (68)  [10]  is: 


•X'k+l  Q'd^'k  “h  bd'U'k 


(69) 


where 


ad  =  e  ~,  AT  =  0.01sec.,  r  =  0.1sec. 

/•AT  ^ 

bd=  -e~rdt 

Jo  r 


and 


ad  +  bd  —  1 


(70) 

(71) 


(72) 


Based  on  Eq.  (68),  the  first-order  low-pass  filter  used  for  smoothing  the  para¬ 
meter  estimate  is 


Kksmoothed  =  A  x  Kk-Ismoothed  +  (1  -  A)  x  Kk  (73) 

where  the  weight  A  is  a  fixed  number  and  0  <  A  <  1.  Unfortunately,  the  low- 
pass  filter  inevitably  introduces  a  lag  in  the  parameter  estimation  process.  This  is 
why  we  are  using  a  low  order  low-pass  filter  for  smoothing  the  parameter  estimate. 
The  lag  introduced  by  the  fixed  low-pass  parameter  filter  is  particularly  problematic 
in  reconfigurable  control,  where  a  (flight)  critical  parameter  is  subject  to  possibly 
abrupt  change. 

The  performance  of  the  low-pass  filter  for  smoothing  the  parameter  estimate 
and  the  performance  of  the  adaptive  control  system  which  uses  this  filter  is  discussed 
in  Chapter  7  in  the  sequel. 
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4-2  Adaptive  Parameter  Filter 

The  simplicity  afforded  by  a  fixed  low-pass  filter  which  exclusively  operates  on 
the  parameter  estimate  provided  by  the  system  identification  algorithm  is  appealing. 
Note  however  that  the  fixed  low-pass  filter  does  not  use  the  available  predicted  para¬ 
meter  estimation  error  variance,  which,  we  recall,  is  reliably  provided  by  the  system 
identification  algorithm.  Using  the  predicted  estimation  error  variance  information 
which  is  provided  by  our  rigorous  system  identification  algorithm,  one  can  selectively 
employ  smoothing.  In  our  specific  situation  in  which  the  system  identification  algo¬ 
rithm  is  rigorously  derived  and  therefore  the  parameter  estimate  is  not  biased  and 
the  parameter  estimation  error  variance  is  reliable,  and  when  the  parameter  esti¬ 
mation  error  variance  is  small,  one  is  justified  in  directly  using  the  plant  parameter 
estimate  in  the  on-line  compensator  synthesis  formula.  Indeed,  when  the  parameter 
estimation  error  variance  is  small  we  can  employ  assumed  certainty  equivalence ,  for 
then  we  know  that  the  parameter  estimate  must  be  close  to  the  true  parameter  value 
(only  if  that  computed  error  variance  is  reliable).  Then,  there  is  no  need  to  filter  the 
parameter  estimate  and  therefore  the  lag  caused  by  passing  the  parameter  estimate 
through  a  low  pass  filter  is  now  removed.  If  however  the  parameter  estimation  error 
variance  is  large  and  we  are  not  confident  using  the  system  identification  -  provided 
parameter  estimate  in  the  compensator  synthesis,  it  is  then  advantageous  to  rely 
on  filtering;  this  is  tantamount  to  postulating  that  the  parameter  does  not  change 
much  during  the  short  time  interval  under  consideration  and  therefore  in  the  on-line 
compensator  synthesis  we  partially  rely  on  the  old  parameter  estimate.  In  this  case 
one  introduces  some  lag. 

Hence,  we  now  make  the  filter  dynamics  dependent  on  the  parameter  estima¬ 
tion  error  variance  provided  by  the  upstream  system  identification  module,  and  in 
doing  so  we  adaptively  filter  the  loop  gain  estimate.  These  insights  into  the  estima¬ 
tion  situation  at  hand  suggest  the  following  strategy: 
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Set  the  weight  of  the  current  parameter  estimate  provided  by  the  system  iden¬ 
tification  algorithm,  1  —  Afc,  to  satisfy 

logiot1  _  *fc)  =  ^(SNRk-SNRk^)  (74) 

where  wt  is  the  moving  window  length  used  in  the  system  identification  algorithm, 
and  the  Signal  to  Noise  Ratio  (SNR)  at  time  k  is  defined  as 

SNRk  =  201og10(-^-)  (75) 

aKk 

Thus,  A  decrease  in  the  SNR  as  moves  from  estimation  window  k  —  wl  to  estimation 
window  k  has  the  effect  of  decreasing  the  reliance  on  the  most  recent  loop  gain 
estimate,  Kk- 

Hence,  the  adaptive  filter  for  the  parameter  estimate  is 

Kksmoothed  =  Afc  x  Kk~ \smoothei  +  (1  -  h)  x  Kk  (76) 

where  the  weight  \k,  0  <  Afc  <  1,  is  adjusted  according  to 

(  )10 

Afc  =  1  -  10  aKk-'"i  (77) 

and  where  cr^fc  is  the  predicted  parameter  ( K )  estimation  error  variance  provided 
by  the  system  identification  module  at  time  instant  k. 

The  adaptive  parameter  estimate  filter,  Eqs.  (76)  and  (77),  automatically 
smoothes  the  parameter  estimate  and  removes  bursting.  The  performance  of  the 
adaptive  filter  for  smoothing  the  parameter  estimate  and  the  performance  of  the 
adaptive  and  reconfigurable  control  system  which  uses  this  filter  is  discussed  in  Chap¬ 
ter  7  in  the  sequel. 
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Jt.3  Discussion 

In  the  conventional  adaptive  control  paradigm  one  assumes  that  while  the 
plant  parameter  is  not  known,  is  time  dependent,  and  is  subject  to  change  and 
therefore  needs  to  be  identified  on-line,  the  parameter  changes  slowly  relative  to  the 
plant  dynamics.  Reconfigurable  control  takes  adaptive  control  to  a  higher  level,  and 
allows  for  abrupt  changes  in  the  parameter,  as  would  be  the  case  under  plant  failure 
conditions.  Hence,  the  reduction  of  the  lag  in  the  parameter  estimate  is  vary  relevant 
to  reconfigurable  control.  Moreover,  reducing  the  lag  in  the  parameter  estimate  is 
particularly  important  when  the  plant  under  consideration  is  open  loop  unstable, 
feedback  control  is  used  for  stabilization,  and  the  parameter  under  consideration 
is  the  critical  open  loop  gain.  Now,  the  adaptive  parameter  estimate  smoother 
developed  herein  uses  all  the  available  information  on  the  plant  parameter  provided 
by  the  on-line  system  identification  module  and  hence  the  lag  and  the  error  in  the 
plant  parameter  estimate  calculated  by  the  smoother  and  sent  to  the  compensator 
is  minimized. 

Hence,  in  this  dissertation  a  novel  adaptive  and  reconfigurable  control  architec¬ 
ture  is  developed  which  implements  an  automatic  anti-bursting  measure  that  entails 
an  adaptive  plant  parameter  smoother  in  tandem  with  the  system  identification 
module.  In  summary,  a  three-module  adaptive  and  reconfigurable  digital  controller 
consisting  of  a  system  identification  algorithm,  an  adaptive  parameter  estimate  low- 
pass  filter,  and  an  on-line  PI  compensator  synthesis  formula,  is  developed. 
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V.  Tracking  Controller 

In  flight  control,  the  aircraft  physical  system  can  be  adequately  represented  as  a 
mathematical  model  and  one  can  synthesize  a  model-based  feedback  controller.  The 
control  law  used  entails  full  state  feedback  [10].  Full  state  feedback  is  indeed  possible 
because  in  the  controller  design  we  use  a  low  order  truth  model  of  the  plant. 

Although  our  indirect  adaptive  control  approach  uses  a  stochastic  dynamic 
model  to  account  properly  for  measurement  noise,  it  is  nevertheless  desirable  to 
consider  a  deterministic  model  first  for  the  purpose  of  control  design.  Also,  the  clean 
states  are  calculated  deterministically,  for  later  comparison  with  the  algorithm’s 
provided  estimates  when  noise  is  included  in  the  simulation. 

In  this  dissertation,  special  attention  is  given  to  the  design  of  the  (linear) 
tracking  controller  so  that  carefully  thought  out  adaptive  and  reconfigurable  flight 
control  experiments  can  be  performed.  In  this  chapter,  we  introduce  a  new  design 
methodology  to  design  the  tracking  controller  and  analyze  the  effect  of  control  surface 
failure  on  the  tracking  controller.  Our  simulation  experiments  validate  the  benefits 
of  adaptive  control,  above  and  beyond  the  benefits  of  conventional  feedback  control. 

5.1  Tracking  Controller  Design  in  State  Space 

Consider  the  following  continuous-time  m- input,  /-output,  plant 

x  =  Ax  +  Bu 


where  x  g  A  g  $Txn,  B  G  3Jnxm,  u  G  y  €  C  G  D  G  9£mxn, 

E  G  9?px",  and  m  +  p  =  l.  Let  w  =  Dx  be  an  m  x  1  vector  representing  the  outputs 
that  are  required  to  follow  an  m  x  1  reference  signal  r  [9] .  In  steady  state,  we  would 
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r  Hr 


x  =  Ax  +  Bu 
y  =  Cx 


Figure  3.  Conventional  Tracking  Control  System 


like  to  have 

w  =  r,  Vr  e  Rm. 

5.1.1  Conventional  Tracking  Controller.  The  conventional  tracking  control 

law  is 

u  =  r  —  Fx,  Fe  3T xn  (78) 

where  F  is  a  stabilizing  feedback  matrix.  A  conventional  closed  loop  tracking  control 
system  is  shown  in  Figure  3.  Thus,  the  closed-loop  system  is 

x  =  (A  —  BF)x  -!-  Br 
y  =  Cx. 

Indeed,  there  is  an  inordinate  amount  of  attention  given  to  stabilizing  feedback 
control  laws  of  the  form  (78)  in  the  control  literature. 

The  steady  state  analysis  of  the  tracking  control  law  (78)  is  now  performed: 

x  =  -(A  —  BF)~lBr 
y  =  Cx 

(. A  -  BF)-lBr  (79) 
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where  the  barred  quantities  represent  steady  state  values.  We  want  asymptotic 
tracking, 

w  =  Dx  =  v  (80) 

i.e., 

r  =  -D(A  -  BF)~lBr  ,  Vr  (81) 

which  yields  the  requirement 

D(A  -  BF)~lB  =  -Im.  (82) 

Hence,  not  only  must  the  matrix  F  be  a  stabilizing  feedback,  but  it  must  also  be 
chosen  such  that  the  tracking  condition  (82)  holds,  which  is  quite  a  restriction. 

5.1.2  Alternative  Tracking  Controller.  Use  the  tracking  proportional  con¬ 
troller 

u  -  Krr  —  Fx 

where  Kr  e  5Rmxm  is  the  reference  input  signal  gain. 

Now,  the  steady  state  analysis  yields  the  tracking  condition 

Kr  =  -(D(A-BF)-1B)~1.  (83) 

We  now  have  the  freedom  to  chose  the  feedback  matrix  F  by  assigning  the  poles  of 
the  closed-loop  system  matrix  arbitrarily,  provided,  of  course,  that  the  poles  locate 
in  the  left-half  complex  plane;  in  other  words,  we  can  chose  the  natural  frequency 
and  thus,  the  bandwidth  of  the  (closed-loop)  tracking  loop. 

5.1.3  PI  Tracking  Controller.  A  PI  controller  can  work  by  increasing  the 
system  type  without  significantly  changing  the  dominant  roots  of  the  characteris- 
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tic  equation.  This  is  done  by  placing  a  zero  close  to  the  origin  to  counteract  the 
integrator  pole  located  at  the  origin. 

In  order  to  include  integral  action  in  state  space,  we  need  to  augment  the  plant: 


x  —  Ax  +  Bu 
z  =  r  —  Dx 


where  z  €  is  the  “charge”  on  the  integrator. 

Use  the  linear  tracking  control  law 

u  —  r  —  Kxx  —  Kzz 


where 

F=(kx,  kz  )  ,  Kxe  3?mxn,  Kz  €  $rxm. 

Hence,  the  augmented  closed-loop  dynamics  are 


According  to  Eq.  (82),  we  need 


( 


I  A  -  BKX 

V 


-BKZ 

0 
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First,  we  need  to  chose  the  proportional  feedback  gain  Kx  to  render  A—  BKX  stable. 
In  addition,  we  want  to  chose  the  integral  gain  Kz  such  that  the  augmented  system 
matrix  is  stable,  and  thus  invertible,  and,  in  addition,  Eq.  (85)  holds. 

In  fact,  the  following  holds: 

A  —  BKX  is  stable  =>  A  —  BKX  is  invertible 
We  require  the  following 


Lemma  5  Consider  the  partitioned  matrix  I  |  where  N  is  a  nxm  matrix, 

P  0 
\  / 

P  is  a  l  x  n  matrix ,  and  M  is  an  x  n  square  and  invertible  matrix .  The  inverse  of 
the  partitioned  matrix  is 


-l 


M  N  \  /  M-1  -  M~lN(PM~1N)~1PM~1  M~1N(PM~1N)~1 

P  0  )  \  (P M~l N)~l P M~l  -{PM-'N)-1 


□ 


The  following  holds. 


Theorem  6  Asymptotic  tracking  is  guaranteed  with  integral  action,  provided  that 
we  chose  a  stabilizing  proportional  feedback  Kx  and  a  non-zero  integral  gain  Kz  s.  t. 
the  closed-loop  system  matrix  is  stable. 

Proof: 

We  apply  Lemma  5  with 

M  =  Ac[  =  A  —  BKX 
N  =  -BKZ 
P  =  -D 
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and  we  use  Eq.  (85).  Hence,  the  inverse  of  the  augmented  matrix  that  features  in 
the  “tracking  condition”,  Eq.  (85),  is 


/  Acl  -BKZ  \ 

V-°  0  / 

/  Aj  -  Ad'BKz(DAd'BKz)~lDA;,1  -Ad'BKz(DAd'BKz)~'  \ 
(  -(DA-d'BKz)-'DA-d'  -(DAd'BK,)-'  ) 

Applying  the  tracking  condition,  Eq.  (85),  we  calculate 


=  -Ira  (86) 

as  required.  Eq.  (86)  show  that  the  “tracking  condition”  for  PI  control  always  holds, 
no  matter  what  the  feedback  control  gains  Kx  and  Kz  are,  provided  that  Kx  and  Kz 
stabilize  the  augmented  dynamics  matrix. 


Remark  7  The  non-zero  integral  gain  Kz  obviously  influences  the  closed-loop  dy¬ 
namics  of  the  tracking  control  system;  in  other  words,  how  fast  we  approach  the 
asymptote.  Moreover,  the  closed-loop  system  needs  to  be  stable  for  the  tracking  con¬ 
dition  to  apply. 

□ 
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Figure  4.  Tracking  Control  System  with  Variable  Open-Loop  Gain  K 

5.1.4  Tracking  under  Failure.  We  now  consider  the  continuous-time  m- 
input,  /-output  plant  with  variable  open- loop  gain  matrix  K  -  see,  e.g.,  Fig.  4: 

x  =  Ax  +  Bu  =  Ax  +  BKu 


0  ^ 

0 

y  0  0  •  •  •  km  j 

is  an  m  x  m  diagonal  matrix,  and  /q  is  the  degree  of  failure  for  different  control 
surfaces. 

For  an  unfailed  control  system,  the  open-loop  gain  matrix  K  remains  an  iden¬ 
tity  matrix,  i.e.,  Aq,  fc2,...,  km  =  1.  If  the  control  surfaces  i  fails  at  time  tf,  the 
control  derivative  is  reduced,  and  0  <  h  <  1,  i.e.,  the  open-loop  gain  matrix  K  is  no 
longer  an  identity  matrix.  When  B  is  changed  to  BK,  Eq.  (79),  and  consequently 
Eq.  (83)  become 

(A  -  BKF)~lBKr 

and 

Kr  =  ~{D(A  -  BKF)~lBK)~l 


where 


/ 


K  = 


h  0 
0  k2 
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respectively.  When  failure  occurs,  the  open-loop  gain  changes,  viz.,  0  <  k\,  k^,.--, 
km<  1..  Then,  with  a  set  state  feedback  gain  F  we  get  from  the  “tracking  condition” , 
Eq.  (82),  and  using  Eqs.  (80),  (81)  and  (83), 

w  =  -D(A  -  BKF)~lBKr 
±  —D(A  -  BF)~lBr  =  r 


and 


Kr  =  -( D{A-BKF)~lBKYl 
^  —(D(A  -  BF)~lB)~l. 

Thus,  the  conventional  proportional  tracking  controller  can  no  longer  track  the  ref¬ 
erence  (command)  signal  correctly. 

Now,  include  a  variable  K  in  our  PI  tracking  control  system.  Then  Eq.  (84) 
becomes 


and  the  tracking  condition,  Eq.  (85),  becomes 


=  -/  (87) 
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where 


AdK  =  A  -  BKKX 
Bk  =  BKKZ. 

Thus,  Eq.  (87)  shows  that,  even  when  the  open  loop  gain  matrix  is  allowed  to  vary, 
the  “tracking  condition”  will  always  hold  when  PI  control  is  employed,  irrespective 
of  the  open  loop  plant  gain  K  and  the  feedback  control  gains  Kx  and  Kz,  provided 
that  stability  is  preserved.  Asymptotic  tracking  is  guaranteed;  however,  in  the  face 
of  control  surface  failure,  the  tracking  performance  suffers. 

In  summary,  whereas  the  conventional  tracking  controller  and  the  proportional 
controller  can  no  longer  maintain  asymptotic  tracking  performance  in  the  face  of 
control  surface  failure,  a  PI  controller  will.  When  control  surface  failure  occurs,  the 
fixed  PI  controller  can  preserve  asymptotic  tracking  performance.  The  proportional 
and  integral  gains  need  to  be  chosen  such  that  closed-loop  stability  is  universally 
achieved,  so  that  the  asymptotic  tracking  result  applies.  Evidently,  nothing  is  said 
here  about  transient  performance. 
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VI.  Aircraft  Model  and  Fixed  PI  Controller 


In  this  research,  an  F-16  class  aircraft  flying  at  Mach  0.9  at  20,000  feet  is  con¬ 
sidered.  The  short  period  pitch  dynamics  approximation  is  used.  The  pitch  dynamics 
are  unstable  and  hence  the  aircraft  relies  on  feedback  control  for  stabilization.  The 
relevant  states  are  a  and  q,  the  aircraft  angle  of  attack  and  pitch  rate,  respectively, 
and  the  control  variable  is  the  elevator  deflection  8e.  Thus,  the  plant  truth  model 
used  in  the  system  identification  algorithm  is 


Zaoc  +  Zqq  +  KZse8e 

(88) 

MaOi  +  Mqq  +  KMse6e. 

(89) 

The  Z  stability  and  control  derivatives  are 


=  -1.3433,  Zq  =  0.9946,  Z6e  =  -0.1525 
and  the  M  stability  and  control  derivatives  are 

Ma  =  3.5,  Mq  =  -1.0521,  MSe  =  -24.3282. 

Hence,  in  (continuous-time)  state  space  form,  the  bare  aircraft  (plant)  dynamics  are 


x 


Ax  +  bu 

l  -1.3433  0.9946  \ 

)x  + 

y  3.5  -1.0521  j 


-0.1525 

-24.3282 


u 


where  the  state 


(90) 
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Bode  Diagram  of  1st  order  actuator  for  F-16  class  A/C 


Frequency  (rad/sec) 


Figure  5.  Bode  Diagram  of  firstst-order  actuator  for  F-16  class  A/C. 


and  the  control  variable  u  is  the  elevator  deflection  6e.  The  above  second-order  plant 
model  is  the  truth  model  used  in  the  system  identification  algorithm. 

In  the  linear  tracking  controller,  the  reference  signal  r  is  summed  with  the 
states  a  and  q  feedback.  The  controller-generated  command  to  the  elevator,  <5Cc,  is 
applied  to  a  first  order  actuator  model  with  a  bandwidth  of  20  rad/ sec.  The 
actuator  output,  Se,  is  the  input  to  the  plant.  A  first-order  actuator  model  suffices 
in  the  “low  frequency”  bandwidth  of  the  pitch  dynamics  as  shown  in  Figure  5.  A 
more  elaborate  fourth-order  actuator  model  [21]  is 

Se(S)  = _ (20.2)  (5097.96)  (144.8) _ 

Sec(S)  (S  +  20.2)(S2  +  10085  +  5097.96)(5  + 144.8)  1  ’ 

and  its  Bode  plot  is  shown  in  Figure  6.  However  the  first-order  actuator  model 
captures  the  lag  characteristics  of  the  actuator  in  the  bandwidth  of  interest. 
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Bode  Diagram  of  4th  order  actuator  for  F- 16  class  A/C 


Frequency  (rad/sec) 

Figure  6.  Bode  Diagram  of  fourth  order  actuator  for  F-16  class  A/C. 

Augmenting  the  dynamics  and  control  matrices  with  the  first-order  actuator 
dynamics  yields  the  third-order  augmented  plant 


x  =  Ax  +  bu 


Now  the  states  are 


The  control  signal  is  conventionally  generated  according  to 

8ec=r  -  (Ka  Kq  KSe)x 


(92) 


(93) 


(94) 
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Table  1.  Longituc 

inal  Dynamics  with  simple  Tracking  Controller. 

System 

Eigenvalues 

Open-loop 

-20.0 

-3.0691 

0.6737 

Closed-loop,  K=1 

-14.4615+15.5040j 

-14.4615-15.5040] 

-1.4724 

Closed-loop,  K=0.8 

- 1434894+ 12.4774j 

-1434894-12.4774j 

-1.4165 

Closed-loop,  K=0.4 

-18.0087 

-11.2516 

-1.1351 

Closed-loop,  K=0.2 

-24.3672 

-5.3706 

-0.6576 

Closed-loop,  K=0.09 

-26.5020 

-3.8255 

-0.0679 

Closed-loop,  K=0.08 

-26.6776 

-3.7210 

0.0032 

and  the  first  order  actuator  dynamics  is 


6e  —  — Se  — 6e 

r  r 


(95) 


where  r  =  0.05  sec.  The  above  third-order  plant  model  is  the  truth  model  used  for 
tracking  controller  design.  The  longitudinal  dynamics  are  given  in  Table  1. 

The  closed  loop  dynamics  A  matrix  is  now  formed  using  the  state  feedback 
tracking  control  law  in  Eq.  (94).  The  resulting  A  and  b  closed  loop  matrices  are 


Arl  = 


B. 


cl 


A  +  b( 

(  ( 


-Ka  -Kq 


-KSe 


Za  Zq  Zge 
Ma  Mq  M6e 


( 


/  n  \ 


(  0  ^ 


+ 


\ 


(  ~Ka 


-Kq  -KSe 


V  0 

0  -7 

) 

Za 

zs.  } 

Ma 

Mq 

Ms. 

~\Ka 

-iK* 

(96) 
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so  we  get 


x  -  Adx  +  Bdr. 


(97) 


This  proportional  controller  does  not  in  general  yield  asymptotic  tracking.  Hence, 
it  is  modified  in  the  sequel. 

The  F-16  class  plant  is  open-loop  unstable.  This  is  a  normal  characteristic  of 
advanced  fighter  aircraft.  Using  full  state  feedback,  the  flight  control  system  is  sta¬ 
bilized.  The  ensuing  closed  loop  linear  state  feedback  control  system  is  very  robust; 
a  well  designed  simple  tracking  controller,  Eq.  (94),  can  handle  open- loop  gains  as 
low  as  Ki  =  0.08  while  preserving  stability,  although  tracking  performance  is  sig¬ 
nificantly  degraded  after  the  degree  of  failure  increases  to  K\  =  0.2.  At  lower  K\ 
values,  the  feedback  stabilization  action  becomes  ineffective  and  the  closed  loop  sys¬ 
tem  becomes  unstable,  as  shown  in  Table  1  and  Figure  7.  In  this  work,  two  tracking 
controllers  are  considered,  a  fixed  proportional  controller  and  a  fixed  Proportional 
plus  Integral  (PI)  controller. 

6. 1  Proportional  Controller 

The  tracking  controller  is  now  designed.  Based  on  it,  a  proportional  controller 
and  an  alternative  fixed  PI  controller  will  be  designed  in  the  following  sections. 

To  find  the  gain  needed  to  improve  tracking  performance,  the  augmented 
closed- loop  state  space  equation  is  used.  The  reference  signal  r(=  q)  is  the  exogenous 
input  and  control  signal  is 

8ec  =  Krr  -  {Kaa  +  Kqq  +  KSe8e).  (98) 

At  steady  state,  x  =  Adx  +  KrBdr  =  0.  Writing  the  augmented  state  space  equation 
with  the  necessary  gain,  Kr,  at  steady  state, 

0  =  Adx  +  KrBdr  (99) 
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Step  response,  K=1 


Step  response,  K=0.8 


_ — _ — - 

-  -  -  Step  input 
-  q  output 

0l - * - ‘ - * - — 1 1 

0  4  8  12  16 

Time  (sec) 


Step  response,  K=0.4 


Step  response,  K=0.2 


Step  response,  K=0.09  Step  response,  K=0.08 


Simple  tracking  step  responses  with  various  open-loop  gains  K 


and  solving  for  x  yields 


x  =  KrAcllBdr. 


(100) 


Substituting  the  above  into  the  output  equation 


y  —  cx 


(101) 


gives  us 


y  =  Krc(Ad'Bdr). 


(102) 


It  is  desired  for  the  output  to  track  a  step  input.  For  this  to  happen 


y  =  r 


(103) 


which  implies 


1  =  KrCA^Bd 


(104) 


must  hold.  Solving  for  u  gain  Kr ,  yields 


Kr  = 


1 


(105) 


which  gives  the  required  reference  signal  gain  needed  for  proper  tracking.  This  gain 
is  then  applied  to  the  system  before  the  feedback  loop  as  shown  in  Figure  1.  This 
adjusts  our  Bd  to  the  following 


Bci  — 


/  0  \ 

0 

\*/ 


(106) 


54 


Table  2.  Longitudinal  Dynamics  with  Proportional  Tracking  Controller. 


System 

Eigenvalues 

Open- loop 

-20.0 

-3.0691 

0.6737 

Closed- loop,  K=1 

-14. 4615+15. 504j 

-14.4615-15.504j 

-1.4724 

Closed-loop,  K=0.8 

-14.4894+12.4774 

-14.4894-12.4774 

-1.4165 

Closed-loop,  K=0.4 

-18.0087 

-11.2516 

-1.1351 

Closed-loop,  K=0.2 

-24.3672 

-5.3706 

-0.6576 

Closed-loop,  K=0.09 

-26.5020 

-3.8255 

-0.0679 

Closed- loop,  K=0.08 

-26.6776 

-3.7211 

0.0032 

The  gains  needed  for  Ka,  Kq  and  K$e  are 


Ka 

=  0.283 

Kq 

=  0.876 

KSe 

=  -0.4. 

So,  the  proper  tracking  dynamics  are  obtained. 

Tracking  is  achieved  using  a  fixed  proportional  controller.  Table  2  shows  the 
eigenvalues  of  the  closed-loop  system  using  the  fixed  proportional  tracking  controller. 

Once  again,  the  open-loop  plant  is  unstable  and  feedback  stabilization  is  used. 
The  closed-loop  system  becomes  unstable  again  when  the  degree  of  control  surface 
loss  becomes  excessively  large,  viz.,  K\  =  0.08  as  shown  in  Table  2  and  Figure  8. 
However,  the  tracking  performance  degrades  significantly  after  the  degree  of  failure 
increases  to  K\  =  0.2. 

6.2  PI  Controller 

Designing  a  PI  controller  in  state  space  for  good  tracking  performance  requires 
the  system  dynamics  to  be  further  augmented.  Now 

z  =  r  —  q  (107) 
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Step  response,  K=1 


Step  response,  K=0.8 
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Proportional  controller  step  responses  with  various  open-loop  gains  K 


and 


(  Za  Zq  Zf,e  0  ^ 


X  = 


Ma  Mq  MSe  0 
0  0-^0 
0-100 

where  the  states  are  now 


V 


X  + 


0 
0 

V1/ 


'o' 


r  + 


Jec 


f  a\ 


(108) 


X  = 


q 

Se 


(109) 


V  2  / 

and,  as  before,  r  is  the  reference  signal.  The  ’’charge”  on  the  integrator  is  z.  Now 
the  PI  control  law  is 


8ec=r  -  Kaa  -  Kqq  -  KSe8e  +  Kzz. 

The  new  closed-loop  system  matrices  Ad  and  Bd  are 

Ac  =  A  +  b(-Ka  -Kq  -KSe  Kz) 


Za 

zq 

z*. 

0  1 

Ma 

Mq 

MSe 

0 

Ka 

(1+X6J 

Kz. 

T 

r 

T 

T 

0 

-l 
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Table  3.  Longitudinal  Dynamics  with  PI  Tracking  Controller. 


System 

Eigenvalues 

Open-loop 

-20.0 

-3.0691 

0.6737 

N/A 

Closed-loop,  K=1 

-14. 4560+15. 4990j 

-14. 4560-15. 4990j 

-1.4733 

-0.01 

Closed-loop,  I<=0.8 

-14.4841+12.4721j 

-14.4841-12. 4721j 

-1.4169 

-0.0103 

Closed-loop,  K=0.4 

-18.0244 

-11.2266 

-1.1328 

-0.0116 

Closed- loop,  K=0.2 

-24.3692 

-5.3625 

-0.6480 

-0.0157 

Closed-loop,  K=0.09 

-0.0352+0.0683j 

-0.0352-0.0683j 

-26.5027 

-3.8222 

Closed-loop,  K=0.08 

0.0005+0.0732j 

0. 0005-0. 0732j 

-26.6782 

-3.7181 

The  proportional  and  integral  gains  needed  to  obtain  good  tracking  performance  are 


Ka 

=  0.283 

Kq 

-  0.876 

Kb. 

=  -0.4 

Kz 

=  0.01. 

(112) 

Thus,  tracking  is  achieved  using  a  fixed  PI  controller.  Table  3  shows  the  poles 
of  the  open-loop  plant  and  the  poles  of  the  closed-loop  system  when  this  fixed  PI 
controller  is  used  for  tracking  control.  As  can  be  seen  in  Table  3  and  Figure  9, 
the  bare  plant  is  originally  open- loop  unstable.  State  feedback  stabilizes  the  a,  q, 
and  6e  states  of  the  unimpaired  closed-loop  flight  control  system.  As  the  loop  gain 
K  is  lowered  from  a  value  of  1,  which  corresponds  to  having  no  failure,  to  a  value 
of  K\  ~  0.08,  an  almost  complete  longitudinal  control  surface  loss,  the  closed-loop 
system  reverts  to  instability  again.  However,  the  tracking  performance  degrades 
significantly  after  the  degree  of  failure  increases  to  Ki  =  0.2. 

In  this  chapter,  the  deterministic  aircraft  model  of  the  control  system  is  devel¬ 
oped.  It  was  shown  how  the  [A  ,  b)  plant  is  augmented  with  actuator  dynamics,  and 
the  tracking  control  law  was  introduced.  Because  the  “standard”  tracking  controller 
could  not  properly  track  a  step  input,  a  proportional  and  a  PI  controller  are  imple- 
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mented  for  two  different  case  studies.  The  closed  loop  matrices  were  found  for  both 
fixed  controllers  and  the  gains  were  designed  by  pole  assignment. 
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VII.  Simulation  Results 


7.1  Experimental  Setup  and  Tmcking  Control 

One  would  like  a  feedback  control  system  to  be  robust  enough  to  perform  within 
specifications  in  the  face  of  parametric  uncertainty,  e.g.,  control  surface  loss  due  to 
failure  or  battle  damage,  and  in  the  presence  of  measurement  noise  and  unmod¬ 
eled  dynamics.  As  the  critical  open-loop  gain  K  decreases  from  K  =  1  to  K  1, 
which  represents  a  transition  from  no  failure  to  substantial  control  surface  loss,  the 
tracking  of  the  reference  signal  slips.  Even  though  failure,  viz.,  a  reduction  in  the 
control  derivative,  causes  a  fixed  controller’s  tracking  performance  to  deteriorate, 
still,  a  correct  system  identification  algorithm  will  properly  estimate  the  degree  of 
failure.  In  fact,  poor  tracking  caused  by  failure  increases  excitation,  which  boosts 
the  performance  of  the  system  identification  algorithm.  Hence  one  is  motivated  to 
use  the  available  signals  required  for  feedback  control  in  an  on-line  system  identi¬ 
fication  algorithm  and  subsequently  adjust  the  controller’s  gain  on  line  in  order  to 
account  for  the  failure-induced  reduction  in  the  plant’s  open-loop  gain,  thus  recov¬ 
ering  performance  and  achieving  adaptive  and  reconfigurable  control  action.  This 
control  concept,  illustrated  in  Figure  1,  is  implemented  in  our  simulation. 

In  most  of  our  MATLAB  [14]  simulations,  the  command  signal  consists  of 
4  pitch  rate  ( qc )  doublet  commands,  having  an  amplitude  of  ±10  deg/sec  and  a 
period  of  4  seconds,  giving  a  16  seconds  measurement  record.  The  input  command 
represents  a  pilot  “exciting  the  stick”  maneuver,  used  in  flight  test.  The  doublets  are 
passed  through  a  low  pass  prefilter,  .  Such  a  prefilter  is  currently  used  in  F-16 
aircraft.  The  pulsed  command  signal  and  the  ensuing  reference  pitch  rate  command 
signal  are  shown  in  Figure  10.  Except  when  specified  otherwise,  a  control  surface 
failure  is  induced  at  tj  =  8  seconds  into  the  flight  in  all  the  test  runs.  This  translates 
into  a  jump  in  the  parameter  K  from  1  to  K  —  0  <  K\  <  1.  In  our  experiments 

the  simulated  degree  of  failure  is  known  and  is  parameterized  by  K\.  Thus,  during 
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Reference  input  signal  as  pitch  rate  command 


Figure  10.  Reference  input  signal  -  pitch  rate  command.  The  “frequency”  is  n/2 
rad/sec  and  the  amplitude  is  10  deg/sec. 

the  first  8  seconds,  we  simulate  an  unimpaired  A/C,  and  at  t  =  tf  =  8  seconds  we 
simulate  an  elevator  surface  loss,  so  that  for  the  remaining  8  seconds  we  control  an 
impaired  A/C.  Hence,  the  open-loop  gain 


1  for  0  <  t  <  8 

K(t)  =  { 

Kx  for  8  <  t  <  16 


where 


0  <  Kx  <  1. 


In  addition,  measurement  (sensor)  noise  is  properly  injected  into  the  simula¬ 
tion.  Thus,  the  measured  pitch  rate  is  qm  —  q  +  vq,  where  vq  =  N  (0,  rC) ,  and  the 
measured  angle  of  attack  is  am  =  a  +  va,  where  va  =  N( 0,  <r^).  Given  that  both  a 
and  q  observations  are  used  for  system  identification,  the  following  definition  of  SNR 
is  used:  _ _ 


SNR  =  20  log 


+  w2q) 


2 

max 


+ 


(113) 
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where  the  weighting 


1 


w  = 


\/\PiP2 


(sec) 


and  pi,  P2  are  the  poles  of  the  open  loop  plant  (the  short  period  approximation): 


Pl  =  0.6737  p2  =  -3.0691. 


In  our  simulations, 


aw  «  7  deg  .,  qmaLX  ~  11  deg /sec. 


The  experimental  results  presented  in  Figures  35-24  were  obtained  using  a  fixed 
cra  =  0.03  deg. 

For  the  SNR  experiments  of  40  and  60  dB,  a  scaled  aq  and  aa  are  used.  We 
initially  let  aq.  =  0.05  deg  /  sec,  and  aa.  =  0.05  deg  and  we  get 

aq  =  kaqi,  oa  =  kaai  (114) 


where  the  SNR  scaling  parameter  k>0.  The  SNR  is  now  expressed  as 


SNR  =  20  log 


+ 

+  w2a^j  k 2 


(115) 


and  therefore,  for  a  specified  SNR,  the  parameter  k  is  determined  according  to 


,  H  SNR 

k  =  10  20  x 


max  1  w  ^max 

Wi  +  ,jj2't5) 


(116) 


and  in  the  simulation  experiments,  <ra  and  aq  are  adjusted  according  to  Eq.  (114). 
The  <tq,  aq  and  SNR  values  are  shown  in  Table  4. 

We  inject  Gaussian  noise  of  intensity  cra  =  0.03  [deg]  and  aq  =  0.1108  [deg/sec] 
using  the  random  numbers  generator  of  MATLAB  [14]  to  simulate  measurement 
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Table  4.  SNR  Values. 


crq  deg  /  sec 

aa  deg 

SNR  dB 

0.56 

11 

25.54 

0.11 

38.96 

0.06 

40 

0.01 

0.03 

47.49 

0.006 

0.006 

60 

noise  for  the  a  and  q  signals.  The  measurement  noise  is  propagated  throughout  the 
feedback  control  system.  The  controller’s  sampling  rate  is  100  Hz.  The  estimate  of 
the  open-loop  gain,  K,  is  continuously  calculated  by  using  the  system  identification 
algorithm  (Theorem  1)  using,  in  most  experiments,  a  moving  data  window  of  length 
0.3  seconds  (30  samples).  The  estimated  gain  is  smoothed,  and,  in  most  experiments, 
the  gain  information  is  used  in  the  proposed  controller  at  each  sample  time  -  thus 
achieving  on-line  operation  of  the  adaptive  and  reconfigurable  control  system. 

The  performance  of  each  of  the  three  modules  of  the  adaptive  and  reconfig¬ 
urable  controller,  viz,  1)  the  system  identification  module,  2)  the  parameter  estimate 
smoother,  and  3)  the  tracking  controller,  is  now  separately  assessed,  followed  by  an 
evaluation  of  the  operation  of  the  complete  adaptive  and  reconfigurable  controller. 

During  the  simulations  of  SNR's  effects,  several  SNRs  listed  in  Table  4  are 
used  in  order  to  analyze  the  SNR's  effect  on  the  estimation  and  tracking  perfor¬ 
mance.  The  window  size  effects  on  the  performance  of  our  three-module  adaptive 
and  reconfigurable  controller  will  be  investigated  too.  For  more  realistic,  we  will 
also  include  unmodeled  dynamics  (Phugoid  dynamics,  fourth-order  actuator,  and 
parameter  modeling  error)  into  our  basic  model,  and  investigate  the  effects. 

7.2  Estimation  Performance 

7.2.1  Expanding  Window  System  Identification.  The  estimation  perfor¬ 
mance  guaranteed  by  the  novel  system  identification  algorithm  stated  in  Theorem 
1  is  experimentally  validated,  and  the  results  of  the  open-loop  gain  identification 
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experiments  are  presented.  The  plant  truth  model  used  in  the  system  identification 
algorithm  is 

OL  —  ZaCt  +  ZqC[  +  KZge 

q  =  Mact  +  Mqq  +  KM$e 

M 

viz.,  the  state  I  evolves  in  5R2  and  the  control  signal  is  u  =  6e.  A  discrete-time 

V q ) 

version  of  the  plant  which  corresponds  to  a  sampling  rate  of  100 Hz  is  embedded 
in  the  system  identification  algorithm.  In  our  experiments,  the  quality  of  the  prior 
information  given  to  the  system  identification  algorithm  is  intentionally  chosen  to 
be  poor.  It  therefore  takes  the  system  identification  algorithm  some  time  to  settle 
down  and  output  the  correct  parameter  estimates. 

Figures  11-14  show  how  the  system  identification  algorithm,  using  an  ex¬ 
panding  horizon  Kalman  filter  (Theorem  1),  estimates  the  open- loop  gain  K  as  the 
degree  of  failure  increases.  The  true  open-loop  gain  K  and  the  identified  open-loop 
gain  K  when  using  the  fixed  PI  tracking  controller  mechanization  are  shown.  The 
parameter  estimate  shown  are  output  by  the  expanding  window  system  identifica¬ 
tion  algorithm  and  the  parameter  estimate  smoother  is  not  used.  The  settling  time 
is  fairly  long.  However,  the  settling  time  is  shortened  when  Ki  is  small.  This  is 
clearly  a  nonlinear  phenomenon.  Also  note  the  large  parameter  estimation  errors 
(spikes)  near  t  =  0,  before  the  estimation  window  fills  up;  also,  it  is  evident  that  the 
initialization  transient  terminates  at  time  t  «  4  sec. 

The  estimation  performance  for  various  degrees  of  failure,  and  the  estimation 
time  delay  defined  when  the  K  estimate  is  within  10%  of  the  true  K  after  failure 
(. K\ ),  is  summarized  in  Table  5. 
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Table  5.  Open-loop  gain  estimation  performance  with  expanding  data  window. 
Fixed  PI  tracking  controller  and  no  parameter  estimate  smoother. 


Actual  Post-Failure 
Open-Loop  Gain  K\ 

Final  Est. 

Value  K 

Relative  Est. 
Error  (%) 

Time  Delay 
(sec .) 

0.8 

0.8878 

10.98 

8.52 

0.6 

0.7311 

21.86 

11.81 

0.4 

0.4602 

15.06 

12.65 

0.2 

0.2073 

3.63 

4.77 

0.1 

0.1006 

0.64 

2.20 

Loop  gain  K  estimate  when  expanding  win.  ID  algo,  is  used.  Failure  K=0.8  at  8  sec 


Figure  11.  Open-loop  gain  estimation  when  K i  =  0.8,  cra  =  0.03  deg  and  oq  = 
0.1108  deg /sec  when  an  expanding  window  system  ID  algorithm  is 
used. 
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Loop  gain  K  estimate  when  expanding  win.  ID  algo,  is  used.  Failure  K=0.6  at  8  sec 


Figure  12.  Open-loop  gain  estimation  when  Ki  =  0.6,  aa  =  0.03 deg  and  aq  = 
0.1108  deg /sec  when  an  expanding  window  system  ID  algorithm  is 
used. 


Loop  gain  K  estimate  when  expanding  win.  ID  algo,  is  used.  Failure  K=0.4  at  8  sec 


Figure  13.  Open-loop  gain  estimation  when  K\  =  0.4,  aa  =  0.03  deg  and  aq  = 
0.1108  deg /sec  when  an  expanding  window  system  ID  algorithm  is 
used. 
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Loop  gain  K  estimate  when  expanding  win.  ID  algo,  is  used.  Failure  K=0.2  at  8  sec 


Figure  14.  Loop  gain  estimation  when  K\  =  0.2,  aa  =  0.03  deg  and  aq  = 
0.1108  deg /sec  when  an  expanding  window  system  ID  algorithm  is 
used. 

7.2.2  Moving-Window  System  Identification.  The  long  parameter  estima¬ 
tion  delays  observed  when  an  expanding  horizon  Kalman  filter  is  used  motivates  us  to 
use  a  moving-window  filter.  A  moving- window  (or,  equivalently,  finite  memory  data 
window)  is  preferred  because,  in  the  case  of  a  failure,  when  a  jump  in  the  value  of 
the  open-loop  gain  K  occurs,  the  latter  is  identified  faster  than  in  the  case  where  the 
expanding  horizon  window  system  identification  algorithm  is  used.  By  using  the  re¬ 
cursive  system  identification  algorithm  (Theorem  1  in  Chapter  3)  inside  a  0.3  second 
window  (of  30  samples) ,  estimates  of  the  parameters  of  interest  are  calculated.  The 
window  is  then  shifted  one  sample  time  and  the  estimation  process  is  repeated.  This 
yields  the  first  parameter  estimate  at  0.3  seconds  into  the  flight.  Prior  information 
with  negative  a  and  q  states  and  an  initial  guess  of  K  =  0.8  are  intentionally  used  to 
test  the  moving-window  estimation  algorithm’s  response  to  a  poor  initial  guess.  For 
all  of  the  windows,  the  same  prior  information  of  a  =  —1.4414  degrees,  q  =  —2.4314 
degrees/second,  and  K  =  0.8  is  used.  The  initial  states  a  and  q  variances  are  0.1 
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K  est.  from  exp.  hr.  &  moving  window  for  PI  contr.  &  K=0.8  at  8sec 


Figure  15.  Comparison  of  expanding  horizon  and  moving  window  estimation  with 
fixed  PI  tracking  controller.  aa  =  0.03 deg  and  <rq  =  0.1108 deg/ sec  . 
Kx  =  0.8. 


[deg2],  1  [(deg / sec)2],  respectively,  and  the  variance  of  the  parameter  K  initial  guess 
is  0.4. 

Setting  the  post  failure  open-loop  gain  at  K\  =  0.8,  K\  =  0.6,  K\  =  0.4, 
and  K\  —  0.2,  we  compare  the  open-loop  gain  ( K )  estimation  performance  of  the 
moving-window  system  identification  algorithm  and  the  expanding  window  system 
identification  algorithm.  The  fixed  PI  tracking  controller,  and  no  parameter  estimate 
filter,  are  used  -  see,  e.g.,  Figures  15  to  18.  One  can  see  that  the  moving- window 
is  faster  to  settle  on  an  estimate,  while  the  expanding  horizon  system  identification 
algorithm  takes  more  time  to  reach  its  final  estimate  value.  Obviously,  the  estimate 
provided  by  the  expanding  window  Kalman  filter  is  smoother  than  the  estimate 
provided  by  the  relatively  short  sliding  window.  At  the  same  time,  the  negative 
effect  on  estimation  performance  of  a  very  short  window  (<C  0.3sec)  is  also  evident 
near  t  =  0. 
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K  est.  from  exp.  hr.  &  moving  window  for  PI  contr.  &  K=0.6  at  8sec 


Figure  16. 


Comparison  of  expanding  horizon  and  moving  window  estimation  with 
fixed  PI  tracking  controller.  aa  =  0.03 deg  and  aq  =  0.1108 deg/ sec  . 


Ki  =  0.6. 


K  est.  from  exp.  hr.  &  moving  window  for  PI  contr.  &  K=0.4  at  8sec 


Figure  17.  Comparison  of  expanding  horizon  and  moving  window  estimation  with 
fixed  PI  tracking  controller.  aa  =  0.03 deg  and  crq  =  0.1108 deg/ sec  . 
Ki  =  0.4. 
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K  est.  from  exp.  hr.  &  moving  window  for  PI  contr.  &  K=0.2  at  8sec 


Figure  18.  Comparison  of  expanding  horizon  and  moving  window  estimation  with 
fixed  PI  tracking  controller.  aa  =  0.03 deg  and  <rq  —  0.1108 deg/ sec  . 
Ki  =  0.2. 

In  Figures  15  to  18,  the  true  parameter  ±  the  predicted  standard  deviation 
of  the  parameter  estimate  calculated  by  the  moving-window  system  identification 
algorithm  are  also  shown.  About  50.84%,  50.97%,  50.53%,  and  51.78%  of  the  K 
estimates,  K,  fall  inside  the  predicted  1  a  bound  for  K\  =  0.8,  K\  =  0.6,  K\  =  0.4, 
and  K\  =  0.2,  respectively.  Also  note  that  when  the  moving-window  system  iden¬ 
tification  algorithm  is  used,  for  certain  data  windows,  the  excitation  in  the  window 
is  poor,  and  these  particular  windows  yield  poor  parameter  estimates.  At  the  same 
time,  the  predicted  parameter  estimation  error’s  standard  deviation,  is  large, 
which  shows  that  the  system  identification  algorithm  is  performing  as  expected.  The 
poor  estimates  occur  when  the  window  slides  past  the  peaks  of  the  input  command, 
as  shown  in  Figures  15  to  18,  i.e. ,  the  spikes  in  the  parameter  estimate  seem  to  be 
correlated  with  the  input  peaks,  as  is  evident  in  Figure  19.  The  input  command  is 
then  near-constant,  which  yields  poor  excitation,  which  is  reflected  in  a  large  a 
this  is  bad  for  adaptive  control. 
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qc  vs  Ke  from  moving  window  for  PI  contr.  &  Failure  K=0.6  at  8  sec 


Figure  19.  The  reference  command  and  the  estimate  K  provided  by  the  mov¬ 
ing  window  system  identification  algorithm.  aa  =  0.03  deg  and  aq  = 
0.1108 deg /sec.  K\  =  0.6. 

In  this  regard,  Figures  20  and  21  show  the  estimation  performance  and  tracking 
performance  when  the  command  signal  is  a  unit  step  function,  i.e.,  a  1  deg/sec 
pitch  rate  step  command.  Although  now,  due  to  the  low  SNR,  and  low  excitation, 
the  parameter  estimate  is  not  so  good  and  the  estimation  error  variance  is  high, 
nevertheless,  about  69.27%  of  the  K  estimates,  K ,  fall  inside  the  predicted  lcr  bound 
of  K.  Evidently,  the  theoretical  score  is  68.3%  -  which,  again  shows  that  the  system 
identification  algorithm  performs  as  expected. 

We  finally  note  that,  good  estimation  performance  is  recorded  when  the  am¬ 
plitude  of  the  input  step  is  10  deg/sec.  This  is  due  to  the  higher  SNR  in  this 
experiment. 


7.2.3  Barker  Code  Sequence  as  Reference  Signal.  The  input  signal  de¬ 
termines  the  excitation  and  thus  strongly  affects  the  estimation  performance  of  the 
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Critical  Loop  Gain  K  Estimated  for  failure  K=0.6.  Window  size  is  30 


Time  (sec) 


Figure  20.  Loop  gain  K  estimate  provided  by  moving  window  identification  algo¬ 
rithm  with  unit  step  (1  deg /sec  pitch  rate)  input  .  Window  size=30. 

Kx  =  0.6. 

SP  outputs  with  moving  win.  ID  &  unit  step  input.  Failure  K=0.6  at  8sec  Window  size  is  30 


Time  (sec) 


Figure  21.  q  and  a  response  when  unit  step  (1  deg /sec  pitch  rate)  command  is 
applied.  Moving  window  system  ID  algorithm  and  fixed  PI  controller 
are  used.  aa  =  0.03  deg  and  aq  =  0.1108  deg  /  sec .  K\  =  0.6. 
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Figure  22.  13- bit  Barker  code. 

system  identification  algorithm  -  as  opposed  to  classical  linear  state  estimation,  i.e., 
Kalman  filtering.  The  estimation  benefits  ensuing  from  using  a  strongly  exciting 
13- bit  Barker  code- like  pilot  command,  as  shown  in  Figure  22,  are  illustrated  in  this 
section.  The  Barker  code  is  used  in  radar.  Since  there  are  three  different  “frequen¬ 
cies”  in  the  13-bit  Barker  code  sequence,  when  it  is  used  as  the  input  command, 
we  get  strong  excitation.  In  our  simulation,  each  bit  of  the  Barker  code  represents 
1  second,  and  the  total  simulation  time  is  now  13  seconds.  The  amplitude  is  10 
deg / sec.  The  failure  is  now  simulated  at  tj  =  6  sec. 

Fig.  23  shows  the  estimation  performance  of  our  moving- window  system  identi¬ 
fication  algorithm  when  the  13-bit  Barker  code  is  used  as  the  reference  signal.  There 
are  some  spikes  occurring  during  bits  1-5,  6-7,  and  8-9,  in  the  less  excited  period  of 
the  input  sequence.  After  bit  10,  the  estimation  performance  is  very  good,  since  the 
input  sequence  is  strongly  exciting.  Moreover,  the  estimation’s  settling  time  is  very 
short. 
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K  Estimate  with  moving  win.  ID  &  Barker  code  input  signal.  Failure  K=0.6  at  6sec 


Time  (sec) 

Figure  23.  K  estimate  when  moving  window  system  ID  algorithm,  fixed  PI  Con¬ 
troller  and  13-bit  Barker  input  reference  signal  are  used.  oa  =  0.03  deg 
and  oq  =  0.1108 deg  /sec  .  Failure  at  tf  —  6  sec.  and  K\  =  0.6. 

The  use  of  a  strongly  exciting  13-bit  Barker  code-like  pilot  command  yields 
good  estimation  performance  and  it  amply  illustrates  the  effect  of  the  input  signal 
on  system  identification  performance. 

7.3  Smoothing  Filter  Performance 

7.3.1  Fixed- Weights  Smoother.  The  estimates  of  K  obtained  from  the 
(short)  moving-window  system  identification  algorithm,  with  low  excitation,  and  at 
relatively  low  SNRs,  have  a  high  aK,  viz.,  they  fluctuate.  Hence,  we  use  the  fixed 
weights  filter,  Eq.  (73)  in  Chapter  4,  to  smooth  the  parameter  estimate  before 
sending  the  latter  to  the  PI  controller  module. 

Smoothing  of  the  system  identification  algorithm’s  parameter  estimate  helps 
to  reduce  the  negative  effects  of  noise,  and  consequently,  bursting,  a.k.a.,  poor  esti¬ 
mation  performance  (during  episodes  of  weak  excitation)  causing  poor  control  per¬ 
formance.  Thus,  smoothing  the  system  identification  provided  parameter  estimate 
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improves  the  end-to-end  tracking  performance  of  the  adaptive  control  system.  Figure 
24  shows  the  direct  effect  of  smoothing  on  the  loop  gain  estimate.  The  dashed  lines 
represent  a  ±20%  error  bound  about  the  true  loop  gain,  K.  We  can  see  that  the 
fixed- weights  smoothing  filter  significantly  reduces  the  fluctuation  in  the  K  estimate. 

However,  smoothing  increases  the  identification  time,  which  is  of  particular 
importance  in  a  control  surface  failure  scenario  for  an  open-loop  unstable  aircraft. 
In  Figure  25,  the  open-loop  gain  estimates  shown  are  smoothed  using  various  filter 
weights.  As  can  be  seen,  when  A  =  0.7  is  used,  the  delay  in  failure  detection  time 
is  greater  than  in  the  unsmoothed  estimates  case  but  is  less  than  when  the  heavier 
smoothing  weights  A  =  0.8  and  A  =  0.9  are  used.  A  reduction  in  estimation  delay 
comes  at  the  expense  of  less  smoothing.  One  must  decide  if  this  is  an  appropriate 
trade-off.  Moreover,  increasing  the  window  length  also  helps  to  reduce  the  negative 
effects  of  noise  and  poor  excitation,  viz.,  the  fluctuations  in  the  open-loop  gain 
estimate  are  reduced,  but  not  as  effectively  as  when  a  low- pass  filter  for  the  parameter 
estimate  is  used. 

7.3.2  Adaptive  Smoother.  A  fixed- weights  smoother  will  reduce  the  fluctu¬ 
ations  in  K ,  but  it  will  uniformly  increase  the  identification  delay,  and,  consequently, 
response  time,  of  the  identification  algorithm,  as  is  evident  in  Figure  25. 

Figure  26  clearly  shows  the  relation  between  the  parameter  estimate  K  and  the 
predicted  standard  deviation  of  the  parameter  estimation  error,  a The  “spikes” 
in  K  occur  when  aK  is  large.  This  indicates  that  our  rigorously  derived  estimation 
algorithm  indeed  yields  a  reliable  predicted  parameter  estimation  error  variance. 
Hence,  we  can  confidently  use  the  oK  information.  Moreover,  Figure  27  shows  the 
spikes  in  the  parameter  estimate  to  be  strongly  correlated  with  a  sudden  increase  in 
the  predicted  parameter  estimation  error  variance  -  in  other  words,  whenever  there 
is  a  spike  in  the  o-K(k)/aK(k  —  wi)  ratio;  W[  denotes  the  window  length.  We  used 
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Unsmoothed  K  q  v.s.  Smoothed  Ke  using  Moving  window  &  K=0.6  at  8  sec 


Figure  24.  Nonsmoothed  and  90%  fixed  weights  smoothed  loop  gain  estimate  K 
when  moving  window  system  ID  algorithm  is  used.  aa  =  0.03  deg  and 
crq  =  0.1108  deg  /  sec.  K\  —  0.6. 


The  effects  of  smoothing  on  failure  detection  time,  K=0.6  at  8  sec 


Figure  25.  The  effect  of  the  fixed  weights  smoothing  of  estimated  parameter  on  the 
settling  time  when  moving  window  system  ID  is  used.  aa  =  0.03  deg 
and  aq  =  0.1108 deg/ sec.  K\  =  0.6. 
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Unsmoothed  K  est.  vs.  oK  for  moving  window  est.  Failure  K  ^0.6  at8 


Figure  26.  Loop  gain  estimate  and  predicted  estimate  error  standard  deviation 
when  moving  window  system  ID  is  used.  cra  =  0.03  deg  and  aq  = 
0.1108 deg /sec.  K\  =  0.6. 

Table  6.  The  Percentage  of  K  Estimates  Falling  Into  the  1-Sigma  Range. 


- ^ - 

K 

K  Inside  1-a 

Not  smoothed 

50.97% 

70%  Smoothed 

52.64% 

80%  Smoothed 

55.59% 

90%  Smoothed 

61.02% 

Adaptively  Smoothed 

65.90% 

this  insight  to  design  an  adaptive  smoother,  as  specified  in  Eqs.  (76)  and  (77)  in 
Chapter  4. 

Figure  28  shows  the  relation  between  the  unsmoothed  parameter  estimate  K , 
adaptively  smoothed  parameter  estimate  K  and  the  adaptively  adjusted  weight  A*, 
used  in  the  adaptive  parameter  smoother.  It  indicates  that  Xk  ~  1,  i.e.,  use  the  pre¬ 
viously  smoothed  estimate  Ksmooth{k- 1),  when  there  is  high  fluctuation  in  estimated 
K.  When  the  fluctuation  is  low,  A k  ~  0,  i.e.,  use  the  current  estimate  K(k).  The 
adaptive  smoother  did  function  as  we  expect  and  adaptively  reduce  the  fluctuation  in 
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Time  (sec) 


Figure  27.  Loop  gain  estimate  and  aK(k)/aK(k—Wi)  when  moving  window  system 
ID  is  used.  aa  =  0.03deg  and  aq  =  0. 1108 deg / sec.  Ki  =  0.6.  (where 
wi  denotes  the  window  length) 


The  relation  between  adaptive  smoothing  and  Xk.  K=0.6  at  8  sec 


Time  (sec) 


Figure  28.  Loop  gain  estimate  and  A k  when  moving  window  system  ID  and  adap¬ 
tive  smoother  are  used.  crQ  =  0.03  deg  and  aq  =  0.1108 deg /sec. 

Ki  =  0.6. 
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1.05 


The  effects  of  smoothing  on  failure  detection  time,  K=0.6  at  8  sec 


Figure  29.  The  effects  of  estimated  parameter  smoothing  on  the  settling  time 
when  moving  window  system  ID  is  used.  cra  =  0.03  deg  and  rrq  = 
0.1108  deg  /  sec.  K\  =  0.6. 


Unsmoothed  K  v.s.  Smoothed  Kq  using  Moving  window  &  K=0.6  at  8  sec 


Figure  30.  Loop  gain  estimate  K  and  smoothed  Ks  when  moving  window  system 
identification,  fixed  weights  smoother  and  adaptive  smoother  are  used. 
c ra  =  0.03 deg  and  aq  =  0.1108 deg/ sec.  Ki  =  0.6. 
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parameter  estimate.  Figures  29  and  30  show  the  parameter  estimation  performance 
comparison  with  no  smoother,  a  fixed-weights  smoother,  and  an  adaptive  smoother 
for  K,  when  the  failure  index  is  K\  =  0.6  at  tf  =  8  seconds.  We  can  see  that  the 
adaptive  smoother,  Eq.  (76),  not  only  yields  the  fastest  identification  time,  but  also 
is  more  effective  than  a  fixed-weights  smoother.  Table  6  shows  the  percentage  of  K 
falling  inside  the  predicted  lcr  bounds  when  no  smoother,  a  fixed-weights  smoother 
and  an  adaptive  smoother  are  used.  We  see  that  the  adaptive  smoother  significantly 
“helps”  the  parameter  estimation  algorithm. 

7-4  Tracking  Controller  Performance 

In  the  tracking  control  experiments,  the  fixed  linear  PI  tracking  controller  de¬ 
sign  in  Chapter  5  is  exercised  first.  This  is  a  fairly  robust  controller  and  it  yields  a 
solid  benchmark  against  which  the  adaptive  and  reconfigurable  controller’s  perfor¬ 
mance  is  gauged.  Next,  the  tracking  performance  of  our  adaptive  and  reconfigurable 
control  system  is  evaluated.  The  tracking  performance  when  using  the  “exciting” 
13-bit  Barker  code  sequence  pilot  command  is  also  discussed. 

7.4.I  Fixed  Proportional  Controller  Performance.  In  general,  post-failure 
tracking  performance  of  the  fixed  proportional  controller  for  the  various  reduced 
open-loop  gain  values  is  similar  to  that  of  the  PI  controller.  The  post-failure  tracking 
performance  of  the  proportional  controller  becomes  unacceptable  when  the  critical 
loop  gain  is  reduced  to  K\  =  0.2.  When  the  critical  loop  gain  is  further  reduced, 
tracking  performance  deteriorates  rapidly  as  shown  in  Figures  31  to  34. 

7-4-2  Fixed  PI  Controller  Performance.  Our  fixed  PI  tracking  controller 
developed  in  Chapter  5  is,  by  design,  fairly  robust.  In  the  simulation  experiments, 
at  time  t  =  8  sec.  into  the  flight,  the  open-loop  gain  K  is  reduced  to  K\  =  0.8, 
K\  —  0.6,  K\  =  0.2,  Ki  =  0.1  and  Kx  =  0.06.  Although  no  discernible  loss  in 
post-failure  tracking  performance  is  recorded  for  K\  =  0.8  in  Figure  35  (due  to  the 
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Short  Period  outputs  for  PR  conlr.  &  Failure  K=0.2  at  8  sec 


Figure  33. 


Figure  34. 


Pitch  rate  q  and  angle  of  attack  a  responses  when  the  fixed  proportional 
controller  is  used.  aa  —  0.03  deg  and  aq  —  0.1108  deg  /  sec.  K\  —  0.2. 


Short  Period  outputs  for  PR  contr.  &  Failure  K=0.1  at  8  sec 


Pitch  rate  q  and  angle  of  attack  a  responses  when  the  fixed  proportional 
controller  is  used.  aa  =  0.03 deg  and  aq  =  0.1108 deg/ sec.  K\  =  0.1. 
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Short  Period  outputs  for  PI  contr.  &  Failure  K=0.8  at  8  sec 


Figure  35.  Pitch  rate  q  and  angle  of  attack  a  responses  when  the  fixed  PI  controller 
is  used,  a a  —  0.03  deg  and  crq  =  0.1108  deg  /  sec.  K\  =  0.8. 

robustness  of  the  fixed  PI  controller),  the  degradation  in  tracking  performance  is 
pronounced  for  Ki  —  0.2,  as  seen  in  Figure  38.  Although  the  control  system  does 
not  become  unstable  until  a  degree  of  failure  which  corresponds  to  Ki  =  0.08  -  see, 
e.g.,  Table  3  -  the  post-failure  tracking  performance  of  the  fixed  PI  controller  falls  out 
of  acceptable  limits  before  this  point,  approximately  when  the  loop  gain  K\  <  0.2 
-  see,  e.g.  Figure  38,  where  the  results  for  Ki  —  0.2  are  shown.  When  the  K  value 
further  decreases  to  K\  =  0.1  and  below,  as  shown  in  Figures  39  and  40,  post-failure 
tracking  performance  of  the  fixed  PI  controller  deteriorates  significantly  and  is  not 
acceptable.  In  both  cases,  when  either  the  fixed  PI  or  the  proportional  tracking 
controller  were  used,  very  similar  identification  results  were  obtained. 

7 -4-3  Adaptive  and  Reconfigurable  Control. 

7. 4-3.1  Expanding  Window  System  Identification.  Now,  a  “conven¬ 
tional”,  two-module,  adaptive  and  reconfigurable  controller  is  implemented.  The 
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Short  Period  outputs  lor  PI  contr.  &  Failure  K=0.2  at  8  sec 


Figure  38. 


Figure  39. 


Pitch  rate  q  and  angle  of  attack  a  responses  when  the  fixed  PI  controller 
is  used.  <7 a  —  0.03  deg  and  aq  =  0.1108  deg  /  sec.  K\  =  0.2. 


Short  Period  outputs  for  PI  contr.  &  Failure  K=0.1  at  8  sec 


Pitch  rate  q  and  angle  of  attack  a  responses  when  the  fixed  PI  controller 
is  used.  <ia  =  0.03  deg  and  a„  =  0.1108  deg  /  sec.  K\  =  0.1. 


Short  period  outputs  for  fixed  PI  contr.  &  Failure  K=0.06  at  8sec 


Figure  40.  Pitch  rate  q  and  angle  of  attack  a  responses  when  the  fixed  PI  controller 
is  used,  a a  =  0.03  deg  and  aq  =  0.1108  deg  /  sec.  K\  =  0.06. 

controller  entails  an  expanding  window  system  identification  module  and  a  variable 
gain  controller.  When  the  expanding  window-based  system  identification  algorithm 
is  used  to  estimate  the  states  a ,  q,  and  the  open-loop  gain  parameter  (K)  for  degrees 
of  failure  of  Ki  =  0.8,  Ki  =  0.6,  K\  =  0.2,  K\  =  0.1  and  Ki  =  0.06,  and  no  parame¬ 
ter  estimate  smoothing  filter  is  used,  the  tracking  performance  is  shown  in  Figures  41 
-  45.  After  the  point  of  failure,  a  considerable  error  between  the  estimated  pitch  rate 
and  the  commanded  pitch  rate  develops.  This  is  mainly  due  to  the  estimation  lag 
in  the  expanding  window  system  identification  module.  However,  the  tracking  per¬ 
formance  improves  as  time  passes,  and  the  expanding  window  system  identification 
algorithm  settles  on  a  good  parameter  estimate,  and  the  pitch  rate  then  tracks  the 
commanded  pitch  rate.  When  the  open-loop  gain  dropped  to  K i  =  0.06  in  Figure  42, 
tracking  at  t  «  10  second  is  temporarily  poor,  because  the  parameter  identification 
delay  is  long,  and  the  fixed  PI  tracking  controller  is  only  able  to  tolerate  a  failure  of 
K\  —  0.08  before  the  control  system  becomes  unstable.  However,  after  a  temporary 
lapse,  the  adaptive  and  reconfigurable  controller  affords  a  recovery  at  t  «  16  second. 
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SP  outputs  when  expanding  window  system  ID  is  used.  Failure  K=0.8  at  8  sec 


Figure  41.  q  and  a  responses  when  expanding  window  system  identification  al¬ 
gorithm  and  reconfigurable  control  are  used.  aa  =  0.03  deg  and 
( 7q  =  0.1108 deg/ sec.  Kx  =  0.8. 


SP  outputs  when  expanding  window  system  ID  is  used.  Failure  K=0.6  at  8  sec 


Figure  42.  q  and  a  responses  when  expanding  window  system  identification  al¬ 
gorithm  and  reconfigurable  control  are  used.  aa  =  0.03  deg  and 
aq  =  0.1108  deg  /  sec .  Kx  =  0.6. 


88 


15 


SP  outputs  when  expanding  window  system  ID  is  used.  Failure  K=0.2  at  8  sec 


Figure  43.  q  and  a  responses  when  expanding  window  system  identification  al¬ 
gorithm  and  reconfigurable  control  are  used.  aa  —  0.03  deg  and 
cjq  =  0.1108 deg / sec.  Kx  =  0.2. 


SP  outputs  when  expanding  window  system  ID  is  used.  Failure  K=0.1  at  8  sec 


Figure  44.  q  and  a  responses  when  expanding  window  system  identification  al¬ 
gorithm  and  reconfigurable  control  are  used.  aa  =  0.03  deg  and 
aq  =  0.1108deg / sec .  Kx  =  0.1. 
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SP  outputs  when  expanding  window  system  ID  is  used.  Failure  K=0.06  at  8  sec 


Figure  45.  q  and  a  responses  when  expanding  window  system  identification  al¬ 
gorithm  and  reconfigurable  control  are  used.  rra  =  0.03  deg  and 
a q  =  0.1108  deg  /  sec .  K\  =  0.06. 


7. 4-3. 2  Moving-Window  System  Identification.  The  tracking  perfor¬ 
mance  of  the  complete,  three-module,  adaptive  and  reconfigurable  controller,  using 
the  moving-window  system  identification  algorithm,  is  shown  in  Figures  46  -  49.  Af¬ 
ter  the  failure,  and  when  K\  =  0.8,  only  a  small  tracking  error  occurs  between  the 
commanded  pitch  rate  and  the  pitch  rate  output.  As  the  degree  of  failure  increases, 
the  tracking  error  increases  too.  However,  the  tracking  performance  is  much  better 
than  that  of  the  fixed  PI  tracking  controller,  and  the  previously  discussed  two-module 
adaptive  tracking  controller  using  an  expanding  window-based  system  identification 
algorithm.  Concerning  the  latter,  the  estimation  lag  is  now  reduced.  This  is  ev¬ 
ident  when  we  compare  Figures  45  and  49,  where  the  open-loop  gain  dropped  to 
K\  —  0.06.  In  Figure  45  where  the  estimation  lag  was  high,  tracking  immediately 
after  the  failure  was  no  longer  acceptable  because  the  fixed  PI  tracking  controller  is 
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Figure  46.  q  and  a.  response  when  moving  window  system  ID  algorithm  &  adaptive 
smoother  are  used.  cra  —  0.03 deg  and  aq  —  0.1108 deg/ sec  .  K\  =  0.8. 

only  able  to  tolerate  a  failure  of  K\  =  0.08  before  letting  the  control  system  become 
unstable. 

7. 4-3. 3  13-bit  Barker  Code  Command.  Figure  50  shows  the  track¬ 
ing  performance  of  the  fixed  PI  controller  when  the  dynamic  13-bit  Barker  code 
sequence  is  used  as  reference  command.  Figures  51  and  52  illustrate  the  tracking 
performance  of  our  two  and  three-module  adaptive  and  reconfigurable  controller 
using  the  expanding  window  system  identification  algorithm  and  moving-window 
system  identification  algorithm,  respectively,  when  the  dynamic  13-bit  Barker  code 
sequence  is  used  as  reference  command,  and  the  control  surface  loss  is  Ki  =  0.6 
and  it  occurs  at  tf  =  6  seconds.  The  tracking  performance  of  the  moving- window 
system  identification  algorithm  is  superior  to  that  of  the  expanding  window  system 
identification  algorithm  and  is  slightly  better  than  the  fixed  PI  controller’s;  recall, 
however,  that  the  fixed  PI  controller  cannot  handle  a  severe  failure,  e.g.,  K\  =  0.2. 


91 


SP  outputs  when  moving  win.  ID  algor.  &  adaptive  smoother  are  used.  Failure  K=0.6  at  8  sec 


Figure  47.  q  and  a  response  when  moving  window  system  ID  algorithm  &  adaptive 
smoother  are  used.  aa  =  0.03  deg  and  aq  =  0.1108  deg  /  sec .  K\  =  0.6. 


SP  outputs  when  moving  win.  ID  algor.  &  adaptive  smoother  are  used.  Failure  K=0.2  at  8  sec 


Figure  48.  q  and  a  response  when  moving  window  system  ID  algorithm  &  adaptive 
smoother  are  used.  aa  =  0.03  deg  and  aq  =  0.1108  deg  /  sec .  K\  =  0.2. 
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SP  outputs  when  moving  win.  ID  algor.  &  adaptive  smoother  are  used.  Failure  K=0.06  at  8  sec 


Figure  49. 


Figure  50. 


q  and  a  response  when  moving  window  system  ID  algorithm  &  adaptive 
smoother  are  used.  aa  =  0.03  deg  and  crq  —  0.1108  deg  /  sec .  Ki  =  0.06. 


q  and  a  response  when  fixed  PI  contr.  &  Barker  code  input  signal  is  used.  Failure  K=0.6  at  6sec 


q  and  a  response  when  fixed  PI  controller  &  13-bit  Barker  code  input 
signal  are  used.  aa  =  0.03 deg  and  <rq  =  0.1 108 deg/ sec.  Failure  at 
t=6  sec.  and  Ki  =  0.6. 


SP  outputs  with  Expending  Kalman  Filter  ID  &  Failure  K=0.6  at  6sec 


Figure  51.  q  and  a  response  when  expanding  window  system  identification  algo¬ 
rithm  &  13-bit  Barker  code  input  signal  are  used.  cra  =  0.03  deg  and 
aq  =  0.1108  deg  /  sec .  Failure  at  t=6  sec.  and  K\  =  0.6. 


SP  outputs  with  moving  win.  ID  &  Barker  code  input  signal.  Failure  K=0.6  at  6sec  Window  size  is  30 


Figure  52.  q  and  a  response  when  moving  window  system  ID  algorithm  &  13- 
bit  Barker  code  input  signal  are  used.  aa  =  0.03  deg  and  aq  = 
0.1108  deg  /  sec .  Failure  at  t=6  sec.  and  K\  =  0.6. 


7.5  SNR  Effects 


With  the  moving- window  system  identification  algorithm,  the  accuracy  of  the 
results  strongly  depends  on  the  measurement’s  Signal-to-Noise  Ratio  (SNR).  This 
is  due  to  the  short  data  window  used  to  calculate  the  estimates.  In  the  previous 
section,  a  SNR  of  38.9557 dB  ( aa  =  0.03  [deg]  and  aq  =  0.1108  [deg/sec])  was  used. 
In  this  section  several  additional  SNRs  listed  in  Table  4  are  experimented  with  in 
order  to  analyze  the  SNR's  effect  on  the  estimation  and  tracking  performance. 

Figures  53  to  57  show  that,  as  the  measurement’s  Signal-to-Noise  Ratio  in¬ 
creases,  the  accuracy  of  the  parameter  estimate  increases,  and  the  tracking  perfor¬ 
mance  also  increases.  The  fluctuations  in  the  gain  estimate,  and  bursting,  caused  by 
instances  of  poor  excitation,  is  significantly  reduced  at  high  SNRs. 

7.6  Window  Size  Effects 

The  effect  of  the  length  of  the  data  window  on  the  estimation  and  tracking 
performance  of  the  system  identification  algorithm  are  investigated.  We  set  the 
window  sizes  wi  used  in  the  moving- window  system  identification  algorithm  at  50, 
40,  30,  20,  and  10,  the  post-failure  open-loop  gain  at  K\  =  0.6,  and  the  Signal-to- 
Noise  Ratio  of  the  measurement  is  SNR  —  38.9557 dB. 

Figures  58  to  61,  and  Figure  54  show  that  a  larger  window  size  yields  better 
parameter  estimates  and  consequently  better  tracking  performance.  Using  longer 
windows  reduces  the  fluctuations  in  the  parameter  estimate,  and  bursting.  However, 
as  shown  in  Figure  62,  longer  windows  bring  about  a  delay  in  the  estimation  of  the 
loop  gain  after  the  failure. 

7. 7  Unmodeled  Dynamics  Effects 

7. 7. 1  Unmodeled  Phugoid  Dynamics.  When  we  add  the  Phugoid  dynamics 

to  our  short  period  A/C  model  with  the  first-order  actuator  augmented  dynamics  - 
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Output  (degree)  Gain  K 


SP  outputs  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  30  SNR=25.5421dB 


Time  (sec) 


Figure  53.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm  and  adaptive  smoother  are  used.  SNR  =  25.5421  dB 
(a a  =  0.03 deg  and  <rq  =  0.55534 deg/ sec).  Failure  at  t=8  sec.  Ky  = 
0.6. 
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Output  (degree)  Gain  K 


K  Est.  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  30  SNR=38.9557dB. 


Time  (sec) 


SP  outputs  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  30  SNR=38.9557dB. 


Time  (sec) 


Figure  54.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm  and  adaptive  smoother  are  used.  SNR  =  38.9557 dB 
(a a  =  0.03  deg  and  aq  —  0.1108  deg  /  sec).  Failure  at  t=8  sec.  Ki  =  0.6. 
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K  Est.  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  30  SNR=40dB. 
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SP  outputs  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  30  SNR=40dB. 


Figure  55.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm  and  adaptive  smoother  are  used.  SNR  =  40 dB  ( cra  = 
0.0602 deg  and  cr„  =  0.0602 deg/ sec).  Failure  at  t=8  sec.  K\  =  0.6. 
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K  Est.  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  30  SNR=47.4847dB. 
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SP  outputs  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  30  SNR=47.4847dB. 


Figure  56.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm  and  adaptive  smoother  are  used.  SNR  =  47.4847 dB 
(a  a  =  0.03  deg  and  aq  =  0.01108  deg /sec).  Failure  at  t=8  sec.  K\  = 
0.6. 
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K  Est.  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  30  SNR=60dB. 


Time  (sec) 


SP  outputs  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  30  SNR=60dB. 


Time  (sec) 


Figure  57.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm  and  adaptive  smoother  are  used.  SNR  =  60 dB  (<ra  = 
0.00602 deg  and  ag  =  0.00602  deg  /  sec).  Failure  at  t=8  sec.  K\  =  0.6. 
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K  Est.  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  50  SNR=38.9557dB. 


Time  (sec) 


SP  outputs  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  50  SNR=38.9557dB. 
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Figure  58.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm  and  adaptive  smoother  are  used.  Window  size  is  50, 
a  a  —  0.03  deg  and  aq  =  0.1108  deg  /sec.  Failure  at  t=8  sec.  K\  =  0.6. 
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K  Est.  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  40  SNR=38.9557dB. 
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SP  outputs  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  40  SNR=38.9557dB. 
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Figure  59.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm  and  adaptive  smoother  are  used.  Window  size  is  40, 
oa  —  0.03  deg  and  aq  —  0.1108  deg  /  sec .  Failure  at  t=8  sec.  K\  —  0.6. 
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K  Est.  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  20  SNR=38.9557dB. 
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SP  outputs  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  20  SNR=38.9557dB. 
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Figure  60.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm  and  adaptive  smoother  are  used.  Window  size  is  20, 
aa  —  0.03  deg  and  oq  =  0.1108  deg  /  sec .  Failure  at  t=8  sec.  K\  =  0.6. 


K  Est.  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  10  SNR=38.9557dB. 
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SP  outputs  of  A.  &  R.  flight  control  system.  Failure  K=0.6  at  8sec  Window  size  is  10  SNR=38.9557dB 
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Figure  61.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm  and  adaptive  smoother  are  used.  Window  size  is  10, 
<7 a  =  0.03  deg  and  aq  =  0.1108  deg  /  sec  .  Failure  at  t=8  sec.  K\  =  0.6. 
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The  effects  of  window  size  on  failure  detection  time,  K=0.6  at  0  sec 
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Figure  62.  The  effects  of  window  size  on  the  settling  time  when  moving  window 
system  ID  is  used.  cra  =  0.03  deg  and  aq  =  0.1108  deg  /  sec.  K\  —  0.6. 

see,  e.g.,  Eq.  (90)  -  the  new  augmented  dynamics  are 
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The  Z  stability  and  control  derivatives  now  are 


Za  = -1.3433,  Zq  =  0.9946,  Zv  =  0,  Ze  =  -0.001,  ZSe  =  -0.1525 

the  M  stability  and  control  derivatives  now  are 

Ma  =  3.5,  Mq  =  -1.0521,  Mv  =  -0.0003,  Me  =  0,  MSe  =  -24.3282 

and  the  X  stability  and  control  derivatives  are 

Xa  =  33.4778,  Xq  =  -26.0592,  Xv  =  -0.0119,  Xe  =  -32.1873,  =  21.6603 

The  above  fifth-order  plant  model  is  then  the  truth  model  used  in  the  simulation, 
with  the  same  system  identification  algorithm,  parameter  estimate  smoother  and  PI 
tracking  controller  as  used  in  the  previous  simulations.  Thus,  we  have  introduced 
low  frequency  unmodeled  dynamics. 

Setting  the  post-failure  open-loop  gain  at  Ki  =  0.6,  window  size  used  in  the 
moving-window  system  identification  algorithm  is  30,  and  the  Signal-to-Noise  Ratio 
of  the  output  states  measurement  is  SNR  —  38.9557 dB.  Figure  63  shows  that  when 
we  include  the  Phugoid  dynamics  into  our  plant,  the  estimation  performance  dete¬ 
riorates  somewhat,  however,  the  tracking  performance  does  not  change  significantly. 
Thus,  unmodeled  low  frequency  dynamics  are  not  so  problematic. 

7 .7.2  Fourth- Order  Actuator.  We  now  exchange  in  the  simulation  the 
first-order  actuator  previously  used  with  the  fourth-order  actuator  specified  in  Eq. 
(91),  but  without  the  Phugoid  dynamics.  Thus,  we  have  introduced  high  frequency 
unmodeled  dynamics.  The  estimation  performance  and  tracking  performance  are 
shown  in  Figure  64.  The  estimation  performance  is  slightly  better  compared  to 
that  when  the  first-order  actuator  is  used.  However,  tracking  performance  degrades 
significantly  when  the  fourth-order  actuator  is  used  in  the  simulation  experiment, 
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K  estimate  with  Moving  win.  ID,  Ad.  smoother  &  PI  cont.  for  K=0.6  at  8sec. 
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q  response  with  Moving  win.  ID,  Ad.  smoother  &  PI  cont.  for  K=0.6  at  8sec. 


Figure  63.  Phugoid  dynamics  are  included  -  q  response  and  adaptively  smoothed 
K  when  moving  window  system  ID  algorithm  and  adaptive  smoother 
are  used.  aa  =  0.03  deg  and  <rq  =  0.1 108  deg  /sec.  K\  =  0.6. 


and  there  is  “ringing”  when  the  reference  command  signal  passes  the  peak  value.  The 
latter  introduces  some  “dither”,  viz.,  excitation,  which  enhances  the  performance  of 
the  system  identification  algorithm.  Indeed,  the  system  identification  algorithm  is 
not  exercised  in  the  presence  of  high  frequency  unmodeled  dynamics  because  in  the 
estimation  algorithm  we  use  the  actual  actuator  deflection  measurement.  Thus,  in 
Figure  64,  one  clearly  sees  the  beneficial  effect  of  dither  on  system  identification 
performance. 

When  we  change  the  control  gain  Kse  from  —0.4  to  —1.5  to  eliminate  the 
“ringing” ,  the  result  is  shown  in  Figure  65.  The  ringing  is  reduced,  and  the  estimation 
performance  is  not  appreciably  degraded.  Note,  however,  the  lag  in  tracking  when 
the  fourth-order  actuator  is  used.  Thus,  to  account  for  the  use  of  a  fourth-order 
actuator,  we  need  to  fine  tune  the  PI  controller  gains  to  reduce  the  “ringing”  effect 
in  tracking. 

7.7.3  Unmodeled  Phugoid  and  Fourth-Order  Actuator  Dynamics.  We  now 
include  in  our  simulation  the  Phugoid  dynamics  and  use  the  fourth-order  actua¬ 
tor  to  assess  their  joint  effects  on  identification  and  tracking  performance.  The 
moving-window  parameter  identification  algorithm  and  the  adaptive  smoother  are 
used.  Figure  66  shows  the  estimation  performance  and  the  tracking  performance 
when  the  control  gain  Kse  remains  -0.4.  Now,  compare  Figure  66  to  Figures  63 
and  64.  We  can  see  that  there  is  still  some  “ringing”  when  the  fourth-order  ac¬ 
tuator  is  used,  but  the  estimation  performance  is  better  than  that  when  only  the 
Phugoid  dynamics  are  included.  Indeed,  the  inclusion  of  the  fourth-order  actuator 
model  improves  the  estimation  performance  and  mitigates  the  bad  influence  of  the 
Phugoid. 

When  we  change  the  control  gain  Kse  to  —1.5,  the  results  are  shown  in  Figure 
67.  We  can  see  that  the  “ringing”  is  reduced  as  expected,  but  the  estimation  perfor¬ 
mance  is  slightly  degraded.  However,  the  estimation  performance  is  still  better  than 
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SP  outputs  when  4th-order  actuator  is  included.  Failure  K=0.6  at  8sec  K  ^=-0.4 
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Figure  64.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm,  adaptive  smoother  and  fourth-order  actuator  are  used. 
Kge  =  —0.4.  a a  =  0.03 deg  and  ag  =  0.1108 deg/ sec.  Failure  at  t=8 
sec.  for  Ki  =  0.6. 
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K  Estimate  when  4th-order  actuator  is  included.  Failure  K=0.6  at  8sec  K  ^=-1 .5 
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SP  outputs  when  4th-order  actuator  is  included.  Failure  K=0.6  at  8sec  K  &=-1 .5 


Figure  65.  Smoothed  K  and  tracking  performance  when  moving  window  system 
ID  algorithm,  adaptive  smoother  and  fourth-order  actuator  are  used. 
Kg  =  —1.5.  <ra  =  0.03deg  and  a„  —  0.1108 deg/ sec.  K\  =  0.6. 


K  Est.  when  Phugoid  dynamics  &  4th-order  actuator  are  included.  Failure  K=0.6  at  8sec  K  ge=-0.4 
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SP  outputs  when  Phugoid  dynamics  &  4th-order  actuator  are  included.  Failure  K=0.6  at  8sec  K  ge=-0.4 


Figure  66.  Smoothed  K  and  tracking  performance  when  moving  window  system  ID 
algorithm,  adaptive  smoother,  Phugoid  dynamics  and  fourth-order  ac¬ 
tuator  are  used.  Kse  =  —0.4.  aa  =  0.03 deg  and  aq  =  0.1108 deg/ sec. 
Kl  =  0.6. 
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Table  7.  Longitudinal  Dynamics  with  PI  Tracking  Controller  when  modeling  error 


Malpha=5  and  Kde— -0.4. 


System 

Eigenvalues  ( Ma  =  5,  Kse  =  —0.4) 

Open-loop 

-20.0 

-3.4325 

1.0371 

N/A 

Closed-loop,  K=1 

-14. 4995+15. 4874j 

-14. 4995-15. 4874j 

-1.3857 

-0.0107 

Closed-loop,  K=0.8 

-14.5399+12.4700j 

-14. 5399-12. 4700j 

-1.3047 

-0.0112 

Closed-loop,  K=0.4 

-17.9041 

-11.5671 

-0.9100 

-0.0142 

Closed-loop,  K=0.2 

-24.3589 

-5.7072 

-0.2968 

-0.0324 

Closed- loop,  K=0.15 

-0. 0374+0. 0813j 

-0.0374-0.0813j 

-25.3846 

-4.9360 

Closed- loop,  K=0.1 

-26.3211 

-4.3121 

0.2097 

0.0281 

Table  8.  Longitudinal  Dynamics  with  PI  Tracking  Controller  when  modeling  error 


Malpha=5  anc 

Kde=-1.5. 

System 

Eigenvalues  ( Ma  =  5,  Kse  =  —1.5) 

Open- loop 

-20.0 

-3.4325 

1.0371 

N/A 

Closed-loop,  K=1 

-38.7367 

-12.5252 

-1.1212 

-0.0123 

Closed-loop,  K=0.8 

-41.6301 

-9.7716 

-0.9803 

-0.0134 

Closed-loop,  K=0.4 

-46.2408 

-5.7282 

-0.4012 

-0.0252 

Closed-loop,  K=0.3 

-0. 0853+0. 0353j 

-0.0853-0.0353j 

-47.2415 

-4.9833 

Closed-loop,  K— 0.25 

-0. 0085+0. 0864j 

-0.0085-0.0864j 

-47.7250 

-4.6534 

Closed-loop,  K=0.2 

0.0777+0.0185j 

-0.0777-0.0185j 

-48.1982 

-4.3526 

that  when  only  the  Phugoid  dynamics  are  included,  but  now  there  is  a  slight  lag  in 
tracking. 


7. 7.4  Parameter  Modeling  Error.  We  now  introduce  modeling  “error”  in 
the  Ma  stability  derivative.  Thus,  in  the  simulation  we  set  Ma  =  5  after  the  failure. 
Table  7  and  8  show  the  poles  of  the  open-loop  plant  and  the  poles  of  the  closed- 
loop  system  when  the  fixed  PI  controller  is  used  with  Ma  =  5.  In  the  presence  of 
modeling  error  ( Ma  —  5),  as  the  loop  gain  K  is  lowered  from  a  value  of  1  to  a  value 
of  Ki  zz  0.1  (when  KSe  =  -0.4)  and  to  a  value  of  Ki  «  0.2  (when  KSe  =  -1.5), 
the  closed-loop  system  reverts  to  instability.  As  we  recall  from  Section  6.2,  without 
parametric  modeling  error,  the  fixed  PI  controller  can  stabilize  the  open-loop  plant 
until  K\  =  0.08.  The  inclusion  of  parameter  modeling  error  degrades  the  stability 
robustness  of  the  flight  control  system. 
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Output  (degree)  Gain  K 


K  Est.  when  Phugoid  dynamics  &  4th-order  actuator  are  included.  Failure  K=0.6  at  8sec  K 


Time  (sec) 


Figure  67.  Smoothed  K  and  tracking  performance  when  moving  window  system  ID 
algorithm,  adaptive  smoother,  Phugoid  dynamics  and  fourth-order  ac¬ 
tuator  are  used.  =  — 1.5.  <Tq,  =  0.03 deg  and  aq  =  0.1 108 deg/ sec. 
Ki  =  0.6. 
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Table  9.  Estimation  performance  without/with  Modeling  Error. 


Window 

Length 

Without  Modeling 

Error 

With  Modeling  Error 
after  Failure 

Before  Failure 

After  Failure 

Before  Failure 

After  Failure  | 

Ma  =  3.5 

Ma  =  3.5 

Ma  =3.5 

.* 

It 

% 

°kJ°k 

% 

% 

% 

vkJ°k 

40 

47.44% 

1.0277 

36.68% 

2.2823 

47.44% 

1.0261 

1.50% 

16.2354 

30 

1.4514 

55.90% 

1.0336 

2.88% 

10.2572 

20 

1.1677 

63.25% 

5.9566 

10 

65.11% 

0.8179 

mzmwM 

0.9802 

2.7440 

8 

63.56% 

0.9170 

0.9990 

63.68% 

0.9166 

■I.HW 

2.7000 

5 

58.70% 

1.3711 

57.63% 

1.1323 

1.7006 

Table  9  show  the  performance  of  the  system  identification  algorithm  after  the 
failure  in  the  presence  of  parametric  modeling  error.  The  percentage  of  the  parameter 
estimates  K  falling  inside  the  predicted  la  bounds,  and  the  ratio  a k€ /<t k  ,  are  shown 
for  window  sizes  wt  of  40,30,20, 10,8,5.  Here  aKe  is  the  experimentally  obtained 
variance  of  the  parameter  estimation  error,  and  a K  is  the  average  predicted  variance 
of  the  parameter  estimation  error: 


<*k,  = 


\ 


fc=i 


and 


(?K 


2 

Kk 


and  where  Ns  is  the  number  of  samples  in  our  experiments.  Thus, 


Ns  = 


1600  —  W[ 
800  —  wi 
800 


for  0  <  t  < 
for  0  <  t  < 
for  8  <  t  < 


16  second, 
8  second, 
16  second, 


Ma  =  3.5, 
Ma  =  3.5, 
Ma  =  5, 


without  modeling  error 
with  modeling  error 
with  modeling  error 


where  w;  is  the  moving-window  length  used  in  the  system  identification  algorithm. 

Figures  68  to  71  show  the  estimation  and  tracking  performance  when  the 
moving-window  system  identification  algorithm  and  no  smoothing  filter  is  used,  with¬ 
out  modeling  error  and  with  modeling  error  after  the  control  surface  failure.  The 
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change  in  Ma  due  to  modeling  error  significantly  degrades  the  estimation  perfor¬ 
mance.  This  is  reflected  in  an  increase  in  the  parameter  estimation  error  variance 
and  in  the  ratio  aKJaK  ^  1.  Moreover,  from  Table  9,  we  can  see  that  in  the  pres¬ 
ence  of  parametric  modeling  error,  the  shorter  the  windows  length  is,  the  higher 
the  percentage  of  K  estimates  falling  inside  the  predicted  lcr  bound  and  the  closer 
the  predicted  parameter  estimation  error  variance  is  to  the  experimentally  obtained 
parameter  estimation  error  variance.  In  addition,  the  parameter  estimation  error 
variance  increases,  which  indicates  that  the  parameter  estimate  needs  to  be  heavily 
smoothed  before  it  is  sent  to  the  controller.  Therefore,  considering  the  estimation 
and  tracking  performance  trade  off,  the  “optimal”  choice  of  window  size  is  30. 

7.7.5  Unmodeled  Phugoid  Dynamics,  Fourth- Order  Actuator,  and  Parameter 
Modeling  Error.  We  now  include  in  our  realistic  simulation  the  Phugoid  dynamics, 
use  the  fourth-order  actuator  model,  and  allow  for  a  post  failure  parameter  mod¬ 
eling  error  ( Ma  =  5).  We  investigate  their  cumulative  effect  on  identification  and 
tracking  performance.  The  moving-window  parameter  identification  algorithm  and 
the  adaptive  smoother  are  used.  The  window  size  is  30,  as  discussed  in  the  pervi¬ 
ous  section.  Figures  72  and  73  show  the  estimation  performance  and  the  tracking 
performance  without  and  with  the  adaptive  smoother,  respectively,  with  the  original 
control  gain  K6e  =  -0.4.  Without  the  adaptive  smoother,  the  effect  of  modeling 
error  on  the  estimation  and  tracking  performance  is  very  pronounced.  Thus,  the 
adaptive  smoother  performs  a  crucial  function  in  the  presence  of  modeling  error. 

When  we  change  the  control  gain  K6e  to  -1.5,  the  results  are  shown  in  Figures 
74  and  75  with  and  without  the  adaptive  smoother,  respectively.  The  “ringing”  is 
now  reduced,  but,  due  to  the  change  in  the  control  gain  K$e,  the  estimation  per¬ 
formance  is  degraded.  Without  the  adaptive  smoother,  the  effect  of  modeling  error 
on  the  estimation  and  tracking  performance  is  more  severe  than  with  the  adaptive 
smoother  in  place.  Comparing  Figures  75  and  67,  we  clearly  see  that  the  parametric 
modeling  error  degraded  both  the  estimation  and  the  tracking  performance. 
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Gain  K  Gain  K  Gain  K 


K  Est.  Window  size  is  40 


K  Est.  Window  size  is  30 


K  Est.  Window  size  is  20 


SP  outputs.  Window  size  is  40 


SP  outputs.  Window  size  is  30 


SP  outputs.  Window  size  is  20 


Figure  68.  Parameter  estimate  K  and  tracking  performance  when  the  moving  win¬ 
dow  system  ID  algorithm  is  used  without  smoother.  cra  =  0.03  deg  and 
(Tq  =  0.1108 deg/ sec .  K\  =  0.6.  Window  lengths  are  40,  30  and  20. 
No  modeling  error. 


Gain  K  Gain  K  Gain  K 


K  Est.  Window  size  is  10 


Time  (sec) 


K  Est.  Window  size  is  8 


Time  (sec) 


SP  outputs.  Window  size  is  10 


SP  outputs.  Window  size  is  8 


SP  outputs.  Window  size  is  5 


Figure  69.  Parameter  estimate  K  and  tracking  performance  when  the  moving  win¬ 
dow  system  ID  algorithm  is  used  without  smoother.  aa  =  0.03  deg  and 
aq  =  0.1108 deg / sec.  K\  =  0.6.  Window  lengths  are  10,  8  and  5.  No 
modeling  error. 


Gain  K  Gain  K  Gain  K 


3 


K  Est.  Window  size  is  40 


SP  outputs.  Window  size  is  40 


Time  (sec) 


K  Est.  Window  size  is  30  SP  outputs.  Window  size  is  30 


K  Est.  Window  size  is  20  SP  outputs.  Window  size  is  20 


Figure  70.  Parameter  estimate  K  and  tracking  performance  when  the  moving  win¬ 
dow  system  ID  algorithm  is  used  without  smoother.  aa  —  0.03  deg  and 
aq  =  0.1108 deg/ sec .  Ki  =  0.6.  Window  lengths  are  40,  30  and  20. 
With  modeling  error  ( Ma  =  5)  after  failure. 
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Gain  K  Gain  K  Gain  K 


K  Est.  Window  size  is  1 0  SP  outputs.  Window  size  is  1 0 


Time  (sec)  Time  (sec) 


K  Est.  Window  size  is  8 


SP  outputs.  Window  size  is  8 


Time  (sec) 


Time  (sec) 


K  Est.  Window  size  is  5  SP  outputs.  Window  size  is  5 


Time  (sec)  Time  (sec) 


Figure  71.  Parameter  estimate  K  and  tracking  performance  when  the  moving  win¬ 
dow  system  ID  algorithm  is  used  without  smoother.  aa  —  0.03  deg  and 
oq  =  0.1108  deg  /  sec .  K\  =  0.6.  Window  lengths  are  10,  8  and  5.  With 
modeling  error  (Ma  =  5)  after  failure. 
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K  Est.  when  Phugoid  dyns.,  4th-order  actu.  &  modeling  err.  are  included  w/o  smoother.  Failure  K=0.6  at  8sec  K  5e=-0.4 
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SP  outs,  when  Phugoid  dyns.,  4th-order  actu.  &  modeling  err.  are  included  w/o  smoother.  Failure  K=0.6  at  8sec  K  5e=-0.4 


Figure  72.  Parameter  estimate  K  and  tracking  performance.  Moving  window 
system  ID  algorithm  ( wl  =  30),  without  smoother.  Phugoid  dy¬ 
namics,  fourth-order  actuator  model  and  parametric  modeling  error 
(Ma  =  5  after  failure)  are  included.  Kge  =  —0.4.  aa  =  0.03  deg  and 
oq  =  0.1108 deg / sec.  K\  =  0.6. 
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Time  (sec) 


Time  (sec) 

Figure  73.  Smoothed  K  and  tracking  performance.  Moving  window  system  ID 
algorithm  ( wl  =  30),  with  adaptive  smoother.  Phugoid  dynamics, 
fourth-order  actuator  model  and  parametric  modeling  error  (Ma  —  5 
after  failure)  are  included.  Kge  =  —0.4.  aa  =  0.03  deg  and  crq  = 
0.1108  deg  /  sec  .  Ki  =  0.6. 
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Figures  77  to  79  show  the  tracking  performance  of  the  fixed  PI  controller,  and 
the  three-module  adaptive  and  reconfigurable  controller  (moving-window  identifica¬ 
tion  algorithm  with  adaptive  smoother),  when  the  Phugoid  dynamics,  the  fourth- 
order  actuator  model,  and  the  post  failure  modeling  error  (Ma  =  5)  are  included.  We 
also  set  the  control  gain  to  the  original  K$e  =  —0.4,  and  the  control  surface  failure 
index  is  K\  =  0.6,  K\  =  0.4,  K\  —  0.2.  Before  the  failure,  the  tracking  performance 
of  the  fixed  PI  controller  and  the  adaptive  and  reconfigurable  controller  are  similar. 
However,  after  the  failure,  the  adaptive  and  reconfigurable  controller  outperforms 
the  fixed  PI  controller,  in  particular,  in  the  severe  failure  case  of  K\  =  0.2,  when  the 
fixed  PI  controller  causes  a  departure. 

Finally,  Figure  76  shows  the  elevator  deflection  and  deflection  rate  when  the 
fixed  PI  controller,  and  the  three-module  adaptive  and  reconfigurable  controller  are 
used.  Phugoid  dynamics,  the  fourth-order  actuator  model,  and  the  post  failure  pa¬ 
rameter  modeling  error  (Ma  =  5)  are  included.  The  case  when  there  is  no  parameter 
modeling  error  is  also  shown  ( Ma  =  3.5).  The  control  gain  is  set  to  Kse  =  —1.5. 
Before  the  failure,  the  elevator  deflection  and  deflection  rate  from  the  fixed  PI  con¬ 
troller  and  the  adaptive  and  reconfigurable  controller  are  similar.  After  the  failure 
and  in  the  presence  of  parameter  modeling  error,  the  elevator  deflection  is  reason¬ 
able  (—6.46°  <  8e  <  6.32°),  however  the  elevator  deflection  rate  after  the  failure  and 
when  adaptive  and  reconfigurable  control  is  used  is  ±65  deg/sec  at  t  ~  10  sec.  This 
is  due  to  the  fact  that  the  smoothed  K  estimate  suddenly  drops  to  Ksmooth  ~  0  - 
see,  e.g.,  Figure  75.  When  there  is  no  parameter  modeling  error  after  the  failure,  the 
elevator  deflection  rate  when  the  adaptive  and  reconfigurable  controller  is  used  is  in 
the  range  of  ±24  deg/sec. 

When  we  change  the  control  gain  Kse  to  —1.5,  the  results  are  shown  in  Fig¬ 
ures  80  to  82.  The  adaptive  and  reconfigurable  controller  outperforms  the  fixed  PI 
controller  in  all  failure  cases.  In  the  case  of  a  severe  failure  ( K\  =  0.2),  the  adaptive 
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and  reconfigurable  controller  shows  some  lag  in  tracking,  but  the  fixed  PI  controller 
causes  a  departure. 

7.7.6  Unmodeled  Phugoid  Dynamics,  Fourth- Order  Actuator,  and  Parameter 
Modeling  Error:  Window  Length  Effect.  We  include  the  unmodeled  Phugoid 
dynamics,  fourth-order  actuator,  and  post  failure  parameter  modeling  error  (Ma= 5) 
into  our  three-module  adaptive  and  reconfigurable  flight  control  system  simulation. 
The  performance  of  the  system  identification  algorithm  is  assessed  when  we  set  the 
window  size  wi  used  in  the  moving- window  system  identification  algorithm  at  120, 
100,  80,  60,  50,  40  and  30.  The  post-failure  open-loop  gain  is  set  at  K\  =  0.6,  0.4,  and 
0.2,  and  the  Signal-to-Noise  Ratio  of  the  measurement  is  SNR  =  38.9557 dB.  Figures 
83  to  89  show  the  estimation  and  tracking  performance  in  each  case.  A  larger  window 
size  yields  better  parameter  estimates,  but  the  tracking  performance  is  reduced. 
Indeed,  using  longer  windows  reduces  the  fluctuations  in  the  parameter  estimate,  and 
bursting.  However,  longer  windows  bring  about  a  delay  in  the  estimation  of  the  loop 
gain  after  the  failure.  From  Table  10,  we  can  see  that  in  the  presence  of  parametric 
modeling  error,  the  shorter  the  windows  size  is,  the  higher  the  percentage  of  K 
estimates  falling  inside  the  predicted  1  a  bound.  At  the  same  time,  the  parameter 
estimation  error  variance  increases,  which  indicates  that  the  parameter  estimate 
needs  to  be  heavily  smoothed  before  it  is  sent  to  the  controller.  Therefore,  when  the 
sampling  rate  is  100  Hz,  and  considering  the  estimation  and  tracking  performance 
trade  off,  the  “optimal”  choice  of  window  size  for  inner  loop  flight  control  is  wi  =  30. 
For  reference  purpose,  Table  11  is  reproduced  for  the  case  when  there  are  no  modeling 
error.  The  adverse  effect  on  estimation  performance  of  modeling  error  is  clearly 
visible. 

7.7.7  Discussion.  From  the  simulation  experiments,  we  conclude  that 
the  unmodeled  dynamics  adversely  affect  the  system  identification  algorithm.  The 
Phugoid  dynamics  will  degrade  the  estimation  performance,  but  preserve  the  track- 
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Time  (sec) 


Time  (sec) 

Figure  74.  Parameter  estimate  K  and  tracking  performance.  Moving  window 
system  ID  algorithm  ( wl  =  30),  without  smoother.  Phugoid  dy¬ 
namics,  fourth-order  actuator  model  and  parametric  modeling  error 
(Ma  =  5  after  failure)  are  included.  Kge  =  — 1.5.  aa  =  0.03  deg  and 
c Tq  =  0.1108 deg / sec.  K\  =  0.6. 
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Figure  75.  Smoothed  K  and  tracking  performance.  Moving  window  system  ID 
algorithm  (wl  =  30),  with  adaptive  sommther.  Phugoid  dynamics, 
fourth-order  actuator  model  and  parametric  modeling  error  (Ma  =  5 
after  failure)  are  included.  Kge  =  —1.5.  aa  =  0.03  deg  and  crq  = 
0.1108  deg  /  sec  .  K\  =  0.6. 
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Figure  76.  Comparison  of  the  elevator  deflection  and  deflection  rate  when  the  fixed 
PI  controller  and  the  adaptive  and  reconfigurable  controller  are  used. 
Phugoid  dynamics,  fourth-order  actuator  model  and  with  and  without 
parametric  modeling  error  ( Ma  —  5  after  failure)  included.  Kge  =  —1.5. 
<ja  =  0.03  deg  and  aq  =  0.1108  deg  /  sec .  K\  =  0.6. 


q  output  when  Phugoid  dyns.,  4th-order  actu.,  modeling  err.  are  included.  Failure  K=0.6  at  8sec  K  ^=*0.4 


Figure  77.  Comparison  of  the  tracking  performance  of  the  fixed  PI  controller 
and  the  adaptive  and  reconfigurable  controller.  Phugoid  dynamics, 
fourth-order  actuator  model  and  parametric  modeling  error  [Ma  =  5 
after  failure)  are  included.  K$e  —  —0.4.  cra  =  0.03  deg  and  <rq  = 
0.1108  deg  /  sec .  K\  =  0.6. 

q  output  when  Phugoid  dyns.,  4th-order  actu.,  modeling  err.  are  included.  Failure  K=0.4  at  8sec  K  ^=-0.4 


Figure  78.  Comparison  of  the  tracking  performance  of  the  fixed  PI  controller 
and  the  adaptive  and  reconfigurable  controller.  Phugoid  dynamics, 
fourth-order  actuator  model  and  parametric  modeling  error  (Ma  —  5 
after  failure)  are  included.  Kse  =  —0.4.  <7a  =  0.03  deg  and  <rq  = 
0.1108  deg  /  sec .  Ki  =  0.4. 
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q  output  when  Phugoid  dyns.,  4th-order  actu.,  modeling  err.  are  included.  Failure  K=0.2  at  8sec  K  ^=-0.4 


Figure  79.  Comparison  of  the  tracking  performance  of  the  fixed  PI  controller 
and  the  adaptive  and  reconfigurable  controller.  Phugoid  dynamics, 
fourth-order  actuator  model  and  parametric  modeling  error  ( Ma  —  5 
after  failure)  are  included.  Kge  =  —0.4.  aa  =  0.03  deg  and  aq  = 
0.1108 deg / sec.  K\  =  0.2. 


q  output  when  Phugoid  dyns.,  4lh-order  actu.,  modeling  err.  are  included.  Failure  K=0.6  at  8sec  K  ^=-1 .5 


Figure  80.  Comparison  of  the  tracking  performance  of  the  fixed  PI  controller 
and  the  adaptive  and  reconfigurable  controller.  Phugoid  dynamics, 
fourth-order  actuator  model  and  parametric  modeling  error  (Ma  =  5 
after  failure)  are  included.  Kse  =  —1.5.  crQ  =  0.03deg  and  aq  = 
0.1108 deg / sec.  K\  =  0.6. 
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q  output  when  Phugoid  dyns.,  4th-order  actu..  modeling  err.  are  included.  Failure  K=0.4  at  8sec  K  fe=-1 .5 


Figure  81.  Comparison  of  the  tracking  performance  of  the  fixed  PI  controller 
and  the  adaptive  and  reconfigurable  controller.  Phugoid  dynamics, 
fourth-order  actuator  model  and  parametric  modeling  error  ( Ma  =  5 
after  failure)  are  included.  Kse  =  —1.5.  <ra  =  0.03  deg  and  a  q  = 
0.1108  deg  /  sec .  K\  —  0.4. 


q  output  when  Phugoid  dyns.,  4th-order  actu.,  modeling  err.  are  included.  Failure  K=0.2  at  8sec  K  fe=-1 .5 


Figure  82.  Comparison  of  the  tracking  performance  of  the  fixed  PI  controller 
and  the  adaptive  and  reconfigurable  controller.  Phugoid  dynamics, 
fourth-order  actuator  model  and  parametric  modeling  error  ( Ma  —  5 
after  failure)  are  included.  Kse  =  —1.5.  aa  =  0.03  deg  and  aq  — 
0.1108  deg  /  sec .  K\  =  0.2. 
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Figure  83.  Moving  window  system  ID  algorithm  ( wl  =  120),  with  adaptive 
smoother.  Phugoid  dynamics,  fourth-order  actuator  model  and  para¬ 
metric  modeling  error  ( Ma  =  5  after  failure)  are  included.  Kge  =  —1.5. 
aa  =  0.03 deg  and  aq  =  0.1108 deg/ sec.  K\  =  0.6,  0.4  and  0.2. 
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Figure  84.  Moving  window  system  ID  algorithm  (wl  =  100),  with  adaptive 
smoother.  Phugoid  dynamics,  fourth-order  actuator  model  and  para¬ 
metric  modeling  error  (Ma  =  5  after  failure)  are  included.  Kse  =  —1.5. 
cra  =  0.03  deg  and  aQ  =  0.1108  deg  /  sec .  K\  =  0.6,  0.4  and  0.2. 
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Figure  85.  Moving  window  system  ID  algorithm  ( wl  —  80),  with  adaptive 
smoother.  Phugoid  dynamics,  fourth-order  actuator  model  and  para¬ 
metric  modeling  error  (Ma  =  5  after  failure)  are  included.  Kge  =  — 1.5. 
aa  =  0.03 deg  and  a„  =  0.1108 deg/ sec.  K\  =  0.6,  0.4  and  0.2. 
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Figure  86.  Moving  window  system  ID  algorithm  (wl  =  60),  with  adaptive 
smoother.  Phugoid  dynamics,  fourth-order  actuator  model  and  para¬ 
metric  modeling  error  ( Ma  =  5  after  failure)  are  included.  Kse  =  —1.5. 
a a  =  0.03 deg  and  aQ  =  0.1108 deg / sec.  K\  =  0.6,  0.4  and  0.2. 
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Figure  87.  Moving  window  system  ID  algorithm  (t ul  —  50),  with  adaptive 
smoother.  Phugoid  dynamics,  fourth-order  actuator  model  and  para¬ 
metric  modeling  error  (Ma  =  5  after  failure)  are  included.  K$e  =  —1.5. 
a a  =  0.03  deg  and  aq  =  0.1108  deg  /  sec .  K\  —  0.6,  0.4  and  0.2. 
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Figure  88.  Moving  window  system  ID  algorithm  ( wl  —  40),  with  adaptive 
smoother.  Phugoid  dynamics,  fourth-order  actuator  model  and  para¬ 
metric  modeling  error  ( Ma  =  5  after  failure)  are  included.  Kge  =  —1.5. 
aa  =  0.03  deg  and  <rq  =  0.1108  deg  /  sec .  K\  =  0.6,  0.4  and  0.2. 
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Figure  89.  Moving  window  system  ID  algorithm  ( wl  =  30),  with  adaptive 
smoother.  Phugoid  dynamics,  fourth-order  actuator  model  and  para¬ 
metric  modeling  error  (Ma  =  5  after  failure)  are  included.  K$e  —  —1.5. 
c 7a  =  0.03  deg  and  aq  =  0.1108  deg  /  sec .  K\  —  0.6,  0.4  and  0.2. 
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Table  10.  Estimation  performance  in  the  presence  of  Phugoid  dynamics,  4th-order 


actuator  and  Parameter  Modeling  Error. 
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Table  11.  Estimation  performance  without  Phugoid  dynamics,  4th-order  actiator 
and  Parameter  Modeling  Error. _ 
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ing  performance.  The  fourth-order  actuator  will  degrade  the  tracking  performance, 
but  enhance  the  estimation  performance.  Using  both  the  Phugoid  dynamics  and  the 
fourth-order  actuator  model  in  our  simulation  experiment,  clearly  illustrates  the  in¬ 
terplay  between  the  various  unmodeled  dynamics  effects  on  estimation  and  tracking 
performance.  However,  the  parametric  modeling  error  not  only  impairs  the  estima¬ 
tion  performance  of  the  moving  window  system  identification  algorithm,  but  it  also 
degrades  the  tracking  performance. 

In  the  presence  of  parametric  modeling  error,  the  reliability  of  the  system 
identification  algorithm  is  a  major  concern.  Thus,  the  estimator’s  performance  is 
gauged  to  a  large  extent  by  the  ratio  gkJ'gk >  where  a is  the  experimentally 
recorded  parameter  estimation  error  variance,  and  aK  is  the  average  of  the  predicted 
parameter  estimation  error  variance.  Unfortunately,  the  latter  is  close  to  1  when  the 
parameter  estimation  error  variance  is  large.  This,  in  turn,  is  the  motivation  for 
using  a  parameter  estimate  smoother  before  using  the  parameter  estimate  to  adjust 
the  controller.  The  latter  invariably  introduces  an  estimation  lag,  which  however 
is  minimized  when  an  adaptive  parameter  estimate  smoother  is  used.  With  the 
adaptive  smoother,  the  estimation  performance  is  enhanced,  and  so  is  the  tracking 
performance. 

Most  importantly,  the  benefit  of  adaptive  and  reconfigurable  control  is  amply 
illustrated  in  Figure  82.  It  is  apparent  that  in  the  case  of  a  sever  failure,  with  a 
fixed  PI  controller  a  departure  is  on  hand,  whereas  the  adaptive  and  reconfigurable 
controller  yields  acceptable  tracking  performance. 
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VIII.  Conclusion  and  Recommendations 

8. 1  Conclusion 

An  adaptive  and  reconfigurable  flight  control  system  is  developed.  The  novel 
three-module  controller  consists  of  1)  a  system  identification  module,  2)  a  parame¬ 
ter  estimate  smoother,  and  3)  a  robust  proportional  and  integral  compensator  for 
tracking  control. 

Two  basic  system  identification  algorithms  were  described  that  were  useful 
for  the  determination  of  the  unknown  parameters  of  a  dynamical  system.  We  are 
particularly  interested  in  on-line  system  identification  for  adaptive  and  reconfigurable 
flight  control.  We  discussed  modeling  error,  disturbances,  and  the  importance  of 
not  over-modeling.  First,  a  frequency  domain  system  identification  approach  for 
estimating  the  unknown  parameters  of  an  nth  order  continuous-time  SISO  system 
was  discussed.  Second,  an  estimation  algorithm  was  also  given  when  measurement 
noise  was  taken  into  account  in  the  modeling  of  the  dynamical  system.  Because 
of  measurement  noise,  careful  stochastic  modeling  was  used  and  a  modified  Least 
Squares  algorithm  was  developed.  It  was  shown  how  the  effect  of  the  noise  can  be 
represented  as  a  weighting  matrix,  R,  in  the  Least  Squares  algorithm,  and,  when 
applied  to  the  least  squares  algorithm,  it  provides  accurate  parameter  estimates. 

A  new  system  identification  algorithm  was  developed  to  identify  the  plant’s 
control  matrix,  viz.,  the  plant’s  open-loop  gain,  K.  We  allow  for  measurement 
noise,  which  is  injected  into  the  a  (angle  of  attack)  and  q  (pitch  rate)  channels 
and  propagates  through  the  feedback  control  system.  The  system  identification 
algorithm  is  akin  to  a  Kalman  filter  and  provides  estimates  of  the  states,  a  and 
q,  and  the  critical  open-loop  gain  plant  parameter.  The  Kalman  equations  were 
manipulated  so  that  the  loop  gain  can  be  estimated  and  explicit  formulae  for  the 
loop-gain  estimate  and  the  predicted  estimation  error  variance  were  derived.  The 
rigorous  system  identification  algorithm  operates  in  the  presence  of  measurement 
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noise  and  provides  an  unbiased  loop  gain  parameter  estimate  and  a  reliable  predicted 
parameter  estimation  error  variance.  On-line  operation  is  achieved,  small  samples 
are  used,  and  no  human  intervention  is  required.  The  algorithm  is  concisely  stated 
in  Theorem  1. 

High  levels  of  measurement  noise  and  poor  excitation  increase  the  parameter 
estimation  error  variance  and  this  causes  the  parameter  estimate  to  fluctuate  as  we 
move  from  window  to  window.  An  adaptive  parameter  estimate  smoother  reduces  the 
fluctuations  automatically  in  the  plant  gain  estimate  used  in  the  “on-line  designed” 
compensator.  This  improves  control  performance  and  reduces  bursting,  caused  by 
instances  of  poor  excitation.  The  adaptive  parameter  estimate  smoother  uses  all 
the  available  information  on  the  plant  parameter  provided  by  the  upstream  on-line 
system  identification  module  and  hence  the  lag,  and  the  error  in  the  plant  parameter 
estimate  calculated  by  the  smoother  and  sent  to  the  compensator,  is  minimized. 
Indeed,  the  role  of  the  parameter  estimate  smoother  is  :  1)  to  reduce  the  inevitable 
fluctuations  in  the  parameter  estimate  prior  to  using  the  latter  in  the  downstream 
on-line  controller  synthesis  algorithm,  and  2)  to  address  the  ill  effects  of  modeling 
error  and,  in  particular  parametric  modeling  error,  on  the  performance  of  the  system 
identification  algorithm;  the  latter  are  an  additional  cause  of  large  fluctuations  in 
the  parameter  estimate  as  we  move  from  window  to  window,  and  to  make  matters 
worse,  the  parameter  estimation  error  prediction  is  then  not  reliable. 

Moreover,  a  model  based  robust  PI  tracking  controller  using  full  state  feedback 
was  synthesized.  The  method  used  to  augment  the  dynamics  to  include  integral  ac¬ 
tion  in  a  state  space  formulation  was  introduced,  and  the  appropriate  tracking  control 
law  was  derived.  The  robust  PI  tracking  controller  provided  the  performance  bench¬ 
mark  against  which  the  performance  of  our  adaptive  and  reconfigurable  controller 
was  gauged. 

Extensive  simulations  were  performed  to  validate  the  novel  adaptive  and  re- 
configurable  flight  control  system.  First,  the  performance  of  our  on-line  system  iden- 
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tification  algorithm  was  thoroughly  investigated.  The  algorithm  was  tested  in  the 
presence  of  the  fixed  PI  controller.  The  expanding  horizon  Kalman  estimates  were 
compared  to  the  estimates  from  the  moving-window  algorithm.  The  performance 
of  both  methods  was  analyzed  and  the  methods  were  compared  for  their  ability  to 
identify  a  failure  quickly,  viz.,  a  loss  of  control  surface  area. 

When  the  fast  moving-window  system  identification  was  implemented,  spots 
of  poorer  estimation  performance,  manifested  as  spikes  in  the  parameter  estimate, 
were  observed  at  time  instants  where  the  pilot’s  reference  signal  peaks.  To  help 
correct  this,  a  fixed-weights  low-pass  filter  (smoothing  module)  for  the  parameter 
estimate  was  initially  tested  for  different  levels  of  smoothing  action.  The  fixed- 
weights  parameter  estimate  filter  introduces  a  lag  into  the  estimation  process.  To 
address  this  problem,  an  adaptive  smoother  was  developed  to  reduce  the  fluctuation 
automatically  in  the  parameter  estimate  and  the  estimation  lag,  and  it  was  shown 
to  outperform  the  fixed-weights  smoother.  Moreover,  the  bursting  phenomenon  is 
automatically  mitigated.  When  the  window  size  is  increased,  the  estimate’s  fluctua¬ 
tions  decreased.  However,  a  shorter  window  is  able  to  detect  a  failure  faster  than  a 
longer  window,  which  is  most  desirable  in  reconfigurable  control. 

The  pilot-like  13-bit  Barker  code  pitch  rate  command  sequence  excitation  was 
also  used  in  the  simulation  experiments  in  a  dynamic  tracking  scenario  and  the 
estimation  performance  of  our  moving-window  system  identification  algorithm  was 
evaluated.  The  moving-window  system  identification  algorithm  preforms  very  well. 
Indeed,  the  input  signal  strongly  affects  the  estimation  performance  of  the  system 
identification  algorithm  -  as  opposed  to  classical  linear  state  estimation,  i.e.,  Kalman 
filtering. 

The  effects  of  measurement’s  Signal  to  Noise  Ratio  was  investigated.  When 
measurement’s  SNR  increases,  the  accuracy  of  the  parameter  estimate  increases, 
and  the  tracking  performance  also  increases.  The  fluctuations  in  the  gain  estimate, 
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and  bursting,  caused  by  instances  of  poor  excitation  is  reduced  significantly  in  high 
SNR. 

The  choice  of  window  length  for  moving-window  system  identification  algo¬ 
rithm  deeply  affects  the  performance.  Using  longer  window  lengths  can  reduce  the 
fluctuations  in  parameter  estimate,  and  bursting,  and  yield  better  parameter  esti¬ 
mates  and  better  tracking  performance. 

Attention  was  also  given  to  unmodeled  dynamics  effects.  Simulations  includ¬ 
ing  unmodeled  Phugoid  dynamics,  a  fourth-order  actuator  model,  and  parametric 
error,  were  performed.  The  unmodeled  Phugoid  dynamics  degrade  the  estimation 
performance,  and  the  fourth-order  actuator  unmodeled  dynamics  reduce  the  tracking 
performance.  Including  both,  gives  similar  tracking  performance  as  with  the  fourth- 
order  actuator  model  only,  but  better  estimation  performance  than  with  Phugoid 
dynamics  only.  However,  parametric  modeling  error  significantly  degrades  the  esti¬ 
mation  and  tracking  performance  of  the  moving-window  system  identification  algo¬ 
rithm  and  is  the  driving  force  for  using  a  parameter  estimate  smoothing  module. 

In  summary,  in  the  novel  three-module  adaptive  and  reconfigurable  controller, 
the  reciprocal  of  the  estimated  loop  gain  derived  from  the  system  identification 
algorithm  and  processed  by  the  smoothing  module  is  used  on-line  to  adjust  the 
compensator,  to  account  for  the  failure,  and  thus  recover  performance.  The  tracking 
performance  of  the  complete  adaptive  and  reconfigurable  control  system  is  shown 
to  be  superior  to  the  tracking  performance  of  the  robust,  but  fixed,  PI  tracking 
controller,  in  particular,  in  the  case  of  a  severe  failure. 

The  adaptive  and  reconfigurable  controller  design  methodology  developed  in 
this  dissertation  is  illustrated  in  a  flight  control  context.  However,  this  development 
is  applicable  to  a  broad  range  of  control  problems. 
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8.2  Contributions 


1.  Developed  three- module  adaptive  and  reconfigurable  controller  which  includes 
an  adaptive  parameter  estimate  smoother.  Improves  estimation  performance 
and  combats  bursting  phenomenon. 

2.  Established  the  parameters  for  the  optimal  operation  of  the  system  identifica¬ 
tion  module,  viz.,  the  sampling  rate  and  the  window  length,  and  experimentally 
investigated  the  SNR  effect. 

3.  Gave  attention  to  the  design  of  a  robust  tracking  controller  which  accommo¬ 
dates  a  control  surface  loss. 

4.  Developed  remedial  action  for  the  accommodation  of  modeling  errors  in  indi¬ 
rect  adaptive  control;  this  includes  low  frequency  unmodeled  dynamics,  high 
frequency  unmodeled  dynamics,  and  parametric  modeling  error. 

8.3  Recommendations  for  Future  Research 

1.  This  dissertation  presented  only  the  single  input  (pitch  rate  command)  of  the 
F-16  class  aircraft.  The  three- module  adaptive  and  reconfigurable  controller 
developed  in  this  dissertation  should  be  applied  to  multiple-input  signals  to 
test  it’s  ability.  One  can  also  create  a  scenario  where  the  B  matrix  is  changed 
due  to  structural  damage. 

2.  To  simplify  the  development  of  the  three- module  adaptive  and  reconfigurable 
controller,  this  dissertation  deal  with  the  measurement’s  noise  only.  Process 
noise  may  be  included  in  the  model  to  give  a  great  insight  on  how  this  controller 
is  performing. 

3.  The  system  identification  module  developed  in  this  dissertation  to  estimate  the 
states  and  the  open-loop  gain  only.  The  results  of  the  experiments  indicated 
that  the  parameter  modeling  error  (Ma)  indeed  affected  the  performance  of 
the  system  identification  module.  We  mitigated  the  bad  effects  by  using  the 
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adaptive  smoother  and  modifying  the  control  gain  (Ks J.  One  could  develop 
another  smoothing  filter  and  fine  tune  the  PI  controller  to  improve  the  per¬ 
formance  of  the  system  identification  module  when  more  modeling  errors  are 
included.  One  could  even  modify  the  system  identification  module  to  also 
estimate  the  stability  derivatives. 
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